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Abstract 


The  results  of  formative  assessments  are  regularly  used  to  infonn  important  instructional 
decisions  (e.g.,  targeted  intervention)  within  a response  to  intervention  (RTI)  system  of 
teaching  and  learning.  The  validity  of  such  instructional  decision-making  depends,  in 
part,  on  the  alignment  between  formative  measures  and  the  academic  content  standards 
on  which  classroom  instruction  is  based,  as  well  as  the  technical  adequacy  of  the 
measures  used  in  RTI  applications.  In  the  following  technical  report,  we  describe  the 
development  and  scaling  of  the  easyCBM  Common  Core  State  Standards  elementary 
school  mathematics  measures  for  use  within  an  RTI  framework.  Within  a given  grade, 
math  items  from  two  distinct  item  pools  were  calibrated  to  a common  horizontal  scale 
using  a 1 -parameter  Rasch  analysis.  The  results  of  the  scaling  were  then  used  to 
construct  13  alternate  forms  designed  to  be  of  comparable  difficulty  - 3 forms  designated 
for  seasonal  benchmark  screening  and  10  designated  for  progress  monitoring.  Prior  and 
subsequent  grade-level  math  items  were  added  to  the  benchmark  test  fonns  as  a basis  for 
constructing  a common  vertical  scale  in  the  future.  Evidence  of  technical  adequacy  is 
reported  in  appendices  by  both  test  form  and  by  the  full  bank  of  CCSS  items  piloted  and 


scaled. 
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The  Development  and  Scaling  of  the  easyCBM  CCSS 
Elementary  Mathematics  Measures:  Grade  3 

The  mathematics  measures  from  the  easyCBM  interim-formative  assessment  system  for 
grades  K-8  were  designed  for  use  in  a Response  to  Intervention  (RTI)  framework  (Alonzo,  Lai, 

& Tindal,  2009a,  2009b,  2009c;  Alonzo  & Tindal,  2009a,  2009b;  Lai,  Alonzo,  & Tindal,  2009), 
which  can  be  used  both  for  whole-school  improvement  (Shores  & Chester,  2009)  as  well  as  to 
identify  students  in  need  of  special  education  services  (VanDerHeyden,  Witt,  & Gilbertson, 
2007).  A functional  RTI  system  hinges  on  the  use  of  measures  that  are  aligned  with  adopted 
content  standards,  so  that  instructional  decisions  are  based  on  results  from  student  assessment 
that  reflect  what  they  are  learning  in  their  classrooms  (Fuchs  & Fuchs,  2006).  The  easyCBM 
measures  were  originally  developed  to  align  with  the  National  Council  of  Teachers  of 
Mathematics  (NCTM)  Focal  Points  Standards  (Nese  et  al.,  2010),  that  were  adopted  by  many 
states  as  the  basis  for  teaching  mathematics. 

In  2010  the  Common  Core  State  Standards  (CCSS)  were  released  as  a guide  for  preparing 
students  for  college  and  careers  (National  Governors  Association  Center  for  Best  Practices  & 
Council  of  Chief  State  School  Officers,  2010).  The  subsequent  endorsement  of  the  standards  by 
the  U.S.  Department  of  Education  (2010)  and  their  recommendation  of  creating  assessments  that 
provide  improved  measurement  of  student  progress  toward  skills  outlined  in  the  CCSS, 
coincided  with  a majority  of  states  adopting  the  CCSS  as  the  basis  for  student  instruction  and 
assessment  (National  Governors  Association  Center  for  Best  Practices  & Council  of  Chief  State 
School  Officers,  2010).  Similarly,  developers  of  curriculum-based  measurements  (CBM),  long 
used  to  monitor  growth  toward  general  outcomes  and  skill  mastery  through  multiple  short, 
technically  adequate,  and  sufficiently  equivalent  test  forms  (e.g.,  Deno,  2003;  Tindal,  2013),  also 
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began  work  to  align  their  measures  with  the  CCSS.  A study  of  existing  easyCBM  math 
measures  to  determine  the  extent  to  which  they  were  in  alignment  with  the  CCSS  followed  in 
2012  (Irvin,  Park,  Alonzo,  & Tindal,  2012a,  2012b;  Park,  Irvin,  Alonzo,  & Tindal,  2012). 

The  2012  alignment  studies  found  reasonable  alignment  between  the  easyCBM 
mathematics  measures  and  the  CCSS  for  grades  K-5;  however,  gaps  across  specific  grade-level 
domains  and  standards  remained.  Identification  of  these  gaps  provided  the  basis  for  developing 
new  technically  adequate  K-5  CCSS-aligned  math  items  and  test  forms  for  use  in  the  easyCBM 
interim-formative  assessment  system  and  in  RTI  application  - the  development,  piloting  and 
scaling  of  which  are  discussed  in  this  technical  report. 

Methods 

In  developing  the  easyCBM  CCSS  mathematics  measures,  we  focused  on  alignment  with 
the  CCSS  and  accessibility  for  diverse  student  populations  with  a range  of  achievement  levels. 
The  following  section  outlines  the  process  we  used  to  develop  math  items  and  subsequently 
assemble  benchmarking  and  progress  monitoring  test  forms  for  use  in  RTI  frameworks  of 
teaching  and  learning. 

Item  Development 

The  K-5  CCSS  in  mathematics  are  comprised  of  four  (Grades  1 and  2)  or  five  (Grades  K, 
3-5)  domains  that  are  further  divided  into  21-28  individual  standards.  Though  some  grade- 
level  standards  were  further  divided  into  more  granular  sub-standards,  such  sub-standards  were 
treated  as  part  of  the  larger  standard;  thus,  an  item  written  to  a given  sub-standard  was 
considered  as  being  written  to  its  parent  standard.  A total  of  3,000  new  CCSS  math  items  were 
written,  500  items  in  each  of  grades  K-5,  based  on  the  gaps  in  CCSS  coverage  identified  through 
previous  research  (Irvin  et  ah,  2012b;  Park  et  ah,  2012). 
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Item  writing  and  review  training.  Two  groups  were  recruited  to  develop  CCSS  math 
items  based  on  their  experience  and  expertise  in  mathematics  teaching  and  learning.  Four  item 
writers  for  each  of  three  grade  bands:  K-l,  2-3  and  4-5,  and  six  item  reviewers,  one  for  each  of 
grades  K-5,  were  recruited.  One  of  the  original  four  item  writers  voluntarily  dropped  from  the 
study,  and  thus,  two  item  writers  split  their  duties  within  the  grade  4-5  band.  Writers  and 
reviewers  were  recruited  to  develop  and  review  math  items  appropriate  to  their  expertise.  On 
average,  item  writers  and  reviewers  had  about  14  years  of  teaching  experience  in  math  education, 
ranging  from  3-32  years.  Each  item  writer/reviewer  held  a Bachelor’s  degree  and  16  of  the  18 
(including  all  reviewers)  also  held  a Master’s  degree.  Item  writers  were  recruited  in  a manner  to 
balance  expertise  across  general  and  special  education  classrooms.  All  item  reviewers  had 
demonstrated  expertise  in  both  general  and  special  education  and  also  worked  in  district 
leadership  positions,  for  example,  as  math  coaches  or  curriculum  developers. 

In  December  2012,  item  writers  and  reviewers  attended  one  of  four  mandatory  2.5-hour 
training  webinars,  led  by  the  lead  project  researcher,  who  was  onsite  at  the  offices  of  Behavioral 
Research  and  Teaching  (BRT)  at  the  University  of  Oregon.  The  webinar  training  consisted  of 
two  main  sections.  An  initial  study  overview  reviewed  the  context  of  the  research  study  and 
described  item  writing  and  reviewing  duties  in  detail.  Specifically,  for  each  new  CCSS  math 
item,  item  writers  and  reviewers  were  required  to  write  a stem  (question  or  prompt)  and  three 
answer  choices  (one  correct  and  two  distractors)  that  were  similar  in  length  and  complexity  level. 
When  constructing  distractor  options,  writers  and  reviewers  were  informed  that  they  should  be 
relevant  to  the  math  skills  required  by  the  problem  - ideally  targeting  a range  of  plausible  student 
mistakes.  Item  writers  and  reviewers  could  also  include  graphics  for  the  stem  and/or  answer 
options  when  relevant  to  the  problem.  When  graphics  were  called  for,  item  writers  provided  a 
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rough  sketch  and/or  description  of  the  graphic,  and  a graphic  artist  later  created  digital  images 
for  each  of  the  graphics.  The  second  training  section  focused  on  techniques  around  effective  and 
appropriate  item  writing,  and  included  principles  of  quality  item/test  development  as  outlined  by 
Haladyna  (2004)  and  Downing  (2006a,  2006b),  and  those  around  Universal  Design  for 
Assessment  (e.g.,  precise  construct  targets,  accessibility  to  diverse  populations,  lack  of  bias)  as 
outlined  by  Thompson,  Johnstone,  and  Thurlow  (2002). 

Throughout  each  section  of  the  webinar  training,  item  writers  and  reviewers  were 
required  to  collaboratively  participate  in  activities  designed  to  ensure  deep  understanding  of 
study  roles,  including  observation  and  discussion  of  math  items.  In  other  words,  a variety  of 
math  items  were  shown  to  writers  and  reviewers,  followed  by  a discussion  of  why  they  met  or 
did  not  meet  the  principles  of  quality  item/test  development  or  why  they  were  (or  were  not) 
aligned  to  the  CCSS.  The  lead  researcher,  writer  and  reviewers  brainstormed  and  discussed 
specific  ways  in  which  items  could  be  altered  to  meet  item  design  principles  or  better  align  to  an 
identified  CCSS  in  instances  where  non-examples  were  shown.  Particular  attention  was  paid  to 
crafting  effective  distractor  options  and  graphics  options  associated  with  math  items.  Effective 
multiple-choice  items  typically  have  one  distractor  option  that  is  “closer”  to  the  correct  response 
and  one  distractor  that  is  “further”  from  the  correct  response  (Haladyna,  2004)  - the  third 
response  option  being  the  correct  answer  for  a given  math  item.  Graphics,  whether  for  the  stem 
and/or  answer  options,  are  included  for  a math  item  only  as  necessary  to  meet  a targeted  content 
standard  and  to  critically  consider  and  solve  a given  math  problem.  This  was  the  manner  in 
which  writers  were  asked  to  write  answer  options  and  include  graphics  for  this  study.  At  the  end 
of  the  training  webinar,  the  item  writing  process  was  again  described  in  detail,  including  the 
specific  roles  of  item  writers  and  reviewers,  in  connection  with  expected  timelines  and 
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deliverables.  The  PowerPoint  Slides  used  in  the  webinar  training  were  adapted  from  those  used 
in  Anderson,  Irvin,  Patarapichayatham,  Alonzo,  and  Tindal  (2012),  and  are  shown  in  Appendix 
A. 

Item  writing.  In  general,  item  writers  and  reviewers  worked  concurrently  to  write,  edit 
and  revise  500  new  CCSS-aligned  math  items  (four  item  sets)  in  each  of  grades  K-5. 

Specifically,  item  writers  wrote  250  new  math  items:  125  items  (in  each  of  two  items  sets)  for 
each  grade  of  their  assigned  grade  band  (i.e.,  K-l,  2-3  or  4-5).  For  example,  “item  writer  1”  was 
assigned  to  write  125  math  items  in  each  of  Grades  K and  1 to  align  with  the  targeted  CCSS. 
Table  1 displays  the  math  item  writing  plan  for  third  grade  by  item  set  and  CCSS.  Item  writers 
iteratively  wrote  and  submitted  items  to  the  lead  researcher  (and  item  reviewers)  in  small  batches 
between  January  and  March  2013,  typically  submitting  between  10-25  items  at  a time  for  further 
review  and  editing.  Throughout  the  iterative  item  writing  process,  item  writers  and  reviewers 
were  in  contact  with  the  lead  researcher  by  email  and  phone  to  hone  their  skills,  and  thus,  the 
quality  and  consistency  of  math  items  produced. 

Item  review.  We  conducted  three  separate  stages  of  item  review  prior  to  item  scaling: 

(a)  review  by  contracted  item  reviewers,  (b)  an  internal  review  by  University  of  Oregon 
education  researchers  at  BRT,  and  (c)  an  external  review  by  individuals  without  prior  connection 
to  the  items.  The  first  review  took  place  concurrently  with  item  writing,  in  which  a single  item 
reviewer  was  assigned  to  review  all  500  math  items  for  a given  grade  level  (K-5).  Prior  to 
contracted  item  reviewers  receiving  items,  the  lead  researcher  briefly  reviewed  the  small  batches 
of  submitted  items  for  completeness,  accuracy  and  features  consistent  with  effective  item  writing 
discussed  during  the  webinar  training  (e.g.,  effective  items,  Universal  Design  for  Assessment), 
subsequently  passing  them  to  the  assigned  reviewer  concurrent  with  the  item  writing  process. 
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Item  reviewers  then  carefully  reviewed  and  edited  each  grade  level  math  item  for  completeness, 
accuracy  and  features  consistent  with  effective  item  writing  discussed  during  the  webinar 
training  - this  included  editing  for  distractor  and  graphical  option  appropriateness.  Further, 
because  item  reviewers  had  access  to  125  items  from  each  of  four  item  writers,  they  also  edited 
math  items  that  were  too  similar  (across  item  writers)  while  attempting  to  maintain  the  content 
and  skill  intention  of  the  item  writers. 

For  the  second  stage  of  item  review,  all  math  items  (subsequent  to  graphics  development 
- see  below)  were  uploaded  to  a secure  website  to  be  reviewed  as  students  would  see  them  in  the 
online  easyCBM  formative  assessment  environment.  Math  items  were  then  assigned  and 
reviewed  internally  by  a group  of  university  education  researchers  from  BRT.  Reviewers 
included  university  faculty  and  doctoral  students  in  education  research  with  experience  in  test 
and  item  development.  During  the  internal  review,  reviewers  again  analyzed  and  edited  items 
for  mathematical  correctness  while  also  looking  for  possible  bias  or  features  inconsistent  with 
Universal  Design  for  Assessment  principles.  Additionally,  internal  reviewers  ensured  that  all 
items  were  formatted  in  a consistent  manner.  All  reviewers  during  this  stage  had  been  trained 
and  taken  part  in  a previous  internal  review  of  middle  school  math  items  (Anderson  et  ah,  2012), 
and  thus,  were  deemed  competent  to  serve  on  the  internal  review  team  in  the  current  study.  A 
team  of  external  reviewers  without  prior  connection  to  the  item  development  conducted  the  final 
item  review.  We  contracted  with  three  individuals  who  did  not  have  item  writing  or  mathematics 
teaching/assessment  experience  to  review  math  items  (on  the  secure  website)  for  mathematical 
accuracy,  consistent  formatting,  and  audio  file  accuracy  (see  below).  Our  intention  behind  this 
manner  of  external  review  was  to  have  a “fresh  look”  at  the  math  items  apart  from  the  item 
writers,  various  reviewers  and  the  lead  researcher,  all  of  whom  had  had  considerable  prior 
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contact  with  the  math  items. 

Graphics  and  audio  development.  We  contracted  with  a professional  graphics  artist  to 
produce  images  for  all  math  items.  The  artist  used  Adobe  Illustrator  to  develop  simple  and  clear 
line  drawings  without  shading  consistent  with  Universal  Design  for  Assessment 
recommendations  (Thompson  et  ah,  2002).  The  artist  produced  graphics  only  when  explicitly 
requested  by  the  item  writer/reviewer  - a development  option  for  the  stem  and/or  the  answer 
options  for  a given  math  item.  The  artist  produced  each  item  graphic  based  on  either  a detailed 
written  description  or  a hand-drawn/electronic  version  (e.g.,  a jpeg  found  on  the  Internet) 
provided  by  an  item  writer/reviewer.  Graphic  images  were  iteratively  edited  based  on  feedback 
from  the  three  review  stages.  We  also  contracted  an  individual  to  produce  audio  recordings  of 
written  text  in  all  math  items.  In  the  easyCBM  online  assessment  system,  students  have  the 
option  to  click  on  a speaker  button  next  to  the  stem  and/or  distractor  answer,  which  results  in 
having  the  text-based  portions  of  the  item  “read-aloud”  to  them.  Audio  recordings  were 
reviewed  and  revised  as  necessary  during  the  second  and  third  review  stages  during  item 
development. 

Scaling 

We  carried  out  four  primary  steps  during  the  scaling  of  the  new  K-5  CCSS  math  items: 

(a)  developing  a piloting  plan,  (b)  selecting  anchor  items  from  the  existing  NCTM-based 
easyCBM  and  the  new  CCSS  math  item  pools  to  create  pilot  forms,  (c)  recruiting  subjects  and 
piloting  the  items,  and  (d)  calibrating  grade-level  items  to  a common  scale. 

Piloting  plan.  For  each  of  grades  K-5,  we  developed  a common  piloting  plan,  comprised 
of  15  total  pilot  forms,  to  guide  pilot  form  creation.  We  included  32  total  math  items  in  each 
form  for  grade  K-l,  and  41  total  items  for  grades  2-5.  Of  the  32  or  41  items  in  a given  pilot 
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form,  we  dedicated  5 horizontal  anchor  items  to  link  to  the  previous  pilot  form  and  5 horizontal 
anchor  items  to  link  to  the  subsequent  pilot  form.  For  example,  pilot  form  2 had  5 anchor  items 
linking  to  pilot  form  1,  and  5 anchor  items  linking  to  pilot  form  3.  This  meant  that  there  were  22 
unique  math  items  in  each  of  the  grade-level  pilot  forms  for  grades  K-l,  and  3 1 for  grades  2-5. 
Of  the  10  total  anchor  items  within  a given  pilot  form,  5 were  selected  from  the  existing 
easyCBM  item  pool  - items  originally  written  to  the  NCTM  Focal  Point  Standards  (Nese  et  al., 
2010),  though  deemed  aligned  to  the  CCSS  in  recent  alignment  studies  (Irvin  et  ah,  2012b;  Park 
et  ah,  2012),  and  5 were  selected  from  the  new  CCSS-based  item  pool.  For  simplicity  and 
clarity,  these  two  pools  will  hereto  be  referred  to  as  NCTM  and  CCSS  item  pools,  though  it 
should  be  noted  that  all  items  used  in  this  project  from  both  pools  had  been  deemed  aligned  to 
the  CCSS  (the  full  combined  CCSS  item  bank). 

By  including  horizontal  anchors  from  both  item  pools,  we  were  able  to  more  than  double 
the  size  of  the  overall  item  pool  from  which  we  would  select  items  to  create  the  operational 
CCSS  test  forms  by  calibrating  the  two  original  pools  to  a common  scale.  Additionally,  this 
saved  valuable  item  writing  and  review  resources.  It  should  be  noted  that  unlike  the  piloting 
plan  used  for  the  easyCBM  CCSS  middle  school  math  measure  development  study  (see 
Anderson  et  ah,  2012),  vertical  (across-grade)  anchor  items  were  not  included  in  the  K-5 
piloting.  Rather,  we  included  prior-  and  subsequent-grade  math  items  in  the  operationalized  test 
forms  for  grades  1-5  (and  prior-grade  items  for  grade  K)  in  order  to  calibrate  a common  scale 
over  the  2013-2014  academic  year,  reasoning  far  more  students  would  provide  item-level 
information  for  the  operationalized  items  as  a basis  for  future  review  of  technical  adequacy  of 
items  and  test  forms  (see  fonn  creation,  below).  The  grades  3-5  piloting  plan,  showing  the 
number  and  placement  of  horizontal  anchor  items  selected  from  both  the  existing  NCTM  as  well 
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as  the  CCSS  item  pools,  is  displayed  in  Table  2. 

Choosing  anchors  and  creating  pilot  forms.  A team  of  four  researchers  (including  the 
lead  researcher)  collaborated  to  select  the  anchor  items  from  the  NCTM  and  CCSS  pools  for 
pilot  forms.  One  of  the  researchers  had  a Ph.D.  in  Educational  Measurement  and  Evaluation, 
and  two  were  doctoral  students  in  the  University  of  Oregon’s  Educational  Methodology,  Policy, 
and  Leadership  program.  The  researcher  with  the  Ph.D.  and  both  doctoral  students  were  familiar 
with  the  math  item  development  and  items,  as  they  had  worked  with  the  lead  researcher  during 
item  writing  and  had  served  on  the  internal  item  review  team. 

As  mentioned  earlier,  anchor  items  for  the  current  piloting  were  selected  from  two 
different  item  pools  by  four  researchers.  Items  selected  from  the  K-5  NCTM  pool  had  been 
previously  piloted  and  scaled  (Alonzo  et  ah,  2009a,  2009b,  2009c;  Alonzo  & Tindal,  2009a, 
2009b;  Lai  et  ah,  2009),  and  thus,  item-level  information  was  available  to  guide  anchor  selection. 
Researchers  followed  a number  of  guidelines  when  selecting  anchor  items  from  the  NCTM  pool. 
Anchor  items  were  selected  to  balance  estimated  difficulty  across  all  1 5 pilot  forms  (easy, 
medium,  hard),  while  also  falling  within  the  acceptable  range  of  mean-square  outfit  values  (0.5 
to  1 .5)  recommended  for  reliable  measurement  in  high-stakes  multiple-choice  test  construction 
(Wright  & Linacre,  1994). 

A further  constraint  for  selection  of  anchor  items  from  the  NCTM  pool  was  that  they  be 
aligned  to  the  CCSS.  Based  on  results  from  Irvin  et  al.  (2012b)  and  Park  et  al.  (2012),  we  cross- 
walked  NCTM  Focal  Point  Standards  and  CCSS  that  were  associated  with  each  other  when 
NCTM-written  items  were  deemed  aligned  to  particular  CCSS  in  the  alignment  studies.  In  this 
manner,  items  originally  written  to  the  NCTM  Focal  Point  Standards,  though  not  necessarily 
included  in  the  2012  alignment  studies,  were  deemed  aligned  to  the  CCSS  and  included  in  the 
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pool  from  which  we  selected  anchor  items  in  the  current  study  (in  addition  to  those  items 
specifically  deemed  aligned  in  the  earlier  studies).  Lastly,  we  attempted  to  stratify  anchor  items 
selected  from  the  NCTM  pool  by  CCSS.  For  instance,  in  third  grade  there  are  5 different  CCSS 
domains  with  a total  of  37  unique  anchor  items  needed  to  populate  the  15  pilot  forms;  thus,  8-9 
items  were  selected  from  each  CCSS  domain  in  third  grade  and  stratified  across  pilot  forms  as 
evenly  as  possible. 

Empirically  estimated  item-level  information  was  not  available  for  items  in  the  new 
CCSS  pool;  thus,  it  was  impossible  to  know  the  difficulty  or  mean-square  outfit  of  items  in  the 
K-5  CCSS  pool  to  guide  anchor  selection.  Therefore,  we  adopted  the  same  anchor  item  selection 
process  used  in  our  previous  easyCBM  CCSS  middle  school  math  item  development  study  (see 
Anderson  et  ah,  2012,  p.  9 and  22),  whereby  our  team  of  four  researchers  worked  together  to 
select  appropriate  anchor  items  for  pilot  forms  based  on:  (a)  an  appropriate  number  of  steps 
required  to  respond  to  the  item  (typically  2-3),  (b)  minimal  language  requirements  outside  of  that 
needed  to  solve  the  math  problem,  (c)  culturally  unbiased  (e.g.,  a blend  of  diverse  names, 
avoiding  overrepresentation  of  subject  matter  unrelated  to  the  targeted  math  knowledge/skills), 
(d)  direct  alignment  to  targeted  CCSS,  and  (e)  consistency  with  principles  of  Universal  Design 
for  Assessment.  As  was  the  case  for  anchor  items  selected  from  the  NCTM  pool,  those  selected 
from  the  CCSS  pool  were  stratified  by  CCSS  domain  in  an  attempt  to  balance  representation 
within  and  across  each  grade-level  pilot  form. 

After  we  selected  horizontal  anchor  items,  we  created  1 5 pilot  forms  for  each  of  grades 
K-5.  For  all  grades,  the  first  4 items  of  each  pilot  fonn  were  unique  items  written  to  the  CCSS  as 
part  of  this  study.  The  next  10  items  (items  5-14)  of  each  form  were  horizontal  anchor  items. 

We  populated  items  5-9  with  anchor  items  selected  from  the  NCTM  pool,  and  items  10-14  with 
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anchor  items  selected  from  the  CCSS  pool.  For  both  bands  of  anchor  items  (5-9  and  10-14), 
either  2 or  3 items  linked  to  previous  or  the  following  pilot  forms  as  shown  in  Table  2.  It  should 
be  noted  that  pilot  forms  1 and  1 5 shared  either  2 or  3 horizontal  anchor  items  between  them, 
given  they  were  at  the  “ends”  of  the  line  of  forms  (i.e.,  form  15  served  as  the  “previous”  form  to 
form  1 and  vice  versa).  In  keeping  with  the  recommendations  of  Kolen  and  Brennan  (2004),  the 
placement  and  order  of  each  anchor  item  were  held  constant  on  a given  pilot  form.  Finally,  the 
unique  items  were  last:  items  15-32  for  grades  K-l,  and  15-41  for  grades  2-5.  All  unique  items 
were  stratified  within  and  across  pilot  forms  by  standard  and  domain  as  appropriate  and  possible 
to  balance  content  representation. 

Participant  recruiting  and  participation.  Over  the  winter  and  spring  of  2013,  teachers 
from  K-5  classrooms  were  recruited  to  participate  in  the  pilot  individually  and  at  the  district  level 
through  the  easyCBM  (http://www.easycbm.com)  and  BRT  websites  (http://www.brtproiects.org 
/about  /current-research),  and  through  existing  research  cooperative  relationships  around  the 
country.  To  protect  confidentiality,  districts,  schools  and  teachers  interested  in  participating 
were  informed  in  writing  that  identifying  information  (e.g.,  demographics)  would  not  be 
collected  on  students  or  teachers,  and  only  information  relevant  to  meeting  research  partnership 
status  would  be  collected  at  the  school  and  district  levels  (e.g.,  the  total  number  of  participating 
students  per  district  or  school).  At  the  same  time,  interested  participants  were  also  given  general 
details  concerning  the  piloting  process,  described  more  specifically  below,  to  make  clear  the 
study  requirements. 

A minimum  of  200  student  responses  per  item  is  desirable  to  obtain  stable  and  accurate 
item  calibrations  using  the  1 -parameter  logistic  Rasch  model  in  a concurrent  equating  design,  as 
was  used  in  the  current  study.  To  fulfill  this  minimum  response  requirement,  we  needed  to 
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recruit  3000  students  (15  forms  * 200  responses)  for  each  of  grades  K-5.  We  were,  however, 
constrained  by  the  end  of  the  academic  calendar  and  recruitment  resources,  and  thus,  we  did  not 
meet  the  minimum  desirable  response  requirements  for  each  form  (and  item).  In  total,  7,700 
students  and  329  teachers  from  140  schools,  in  132  districts,  across  33  states  participated  in  the 
piloting  portion  of  the  study  that  began  on  May  15,  2013  and  ended  on  June  15,  2013.  The 
following  number  of  students  participated  in  the  pilot  by  grade:  731  (grade  K),  1,124  (grade  1), 
1,136  (grade  2),  1,685  (grade  3),  1,499  (grade  4)  and  1,525  (grade  5).  Final  pilot  participation 
statistics  by  grade  and  fonn  are  given  in  Table  3. 

Piloting  process.  Once  they  agreed  to  participate,  teachers  were  given  detailed 
instructions  on  how  to  access  the  secure  piloting  website,  how  to  have  their  students  select  the 
appropriate  grade  level  (K-5),  and  how  their  students  would  begin  and  take  the  online  test. 
Students  were  instructed  to  use  scrap  paper  as  necessary,  but  not  to  use  calculators  to  complete 
any  math  items.  Once  students  selected  their  appropriate  grade,  they  were  shown  a title  screen 
that  prompted  them  to  begin  the  test  by  clicking  an  onscreen  button  when  ready.  Students  were 
then  immediately  administered  one  of  15  grade-level  pilot  forms.  The  administered  test  form 
was  automatically  assigned  by  the  piloting  website,  based  on  the  number  of  students  who  had 
completed  that  form  previously.  In  other  words,  students  were  assigned  the  grade-level  pilot 
form  with  the  fewest  number  of  completions  across  all  students  in  the  pilot.  Student  responses 
(a,  b,  or  c)  were  automatically  recorded  in  a secure  online  database  based  on  which  response 
option  a student  selected,  with  the  position  in  which  the  three  answer  options  (a,  b,  or  c)  were 
displayed  on  the  students’  computer  screens  randomized  each  time  an  item  was  administered. 
Given  that  pilot  forms  were  assigned  based  on  the  number  of  times  they  had  been  completed  and 
that  answer  options  were  randomly  rotated  each  time  an  item  was  administered,  cheating  was  a 


easyCBM  CCSS  Third  Grade  Math  Measure  Development 


13 


limited  concern.  A screen  capture  of  a third  grade  math  item  demonstrative  of  how  all  items 
displayed  on  the  pilot  website  (and  indeed  the  K-8  easyCBM  formative  assessment  system)  is 
shown  in  Figure  1. 


Figure  1.  Screen  capture  of  math  item  illustrating  online  display  of  math  items  in  the  pilot  study 
and  easyCBM  assessment  system. 

Item  calibration.  All  math  items,  including  those  from  the  larger  and  previously- 
existing  NCTM  pool,  were  calibrated  to  the  same  scale  using  a 1-parameter  logistic  (1PL)  Rasch 
model  in  a concurrent  equating  design  using  Winsteps  3.6.8  (Linacre,  2009).  In  the  Rasch 
model,  a special  case  of  the  1 -parameter  logistic  model  in  which  the  item  discrimination 
parameter  is  constrained  to  1.0  and  student  ability  is  freely  estimated  (Linacre,  2008),  all  item 
and  student  parameters  are  estimated  simultaneously  from  a single  data  file  that  contains  all 
student  responses,  grades  K-5.  The  concurrent  equating  design  estimates  student  ability  based 
on  their  responses  to  items,  treating  any  non-responses  as  missing.  Items  are  placed  on  the  same 
scale  through  the  inclusion  of  anchor  items  across  grade  level  forms,  displayed  in  Table  2. 
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The  Rasch  model  is  defined  as 


P(XLS 


H es,pd  = 


exp[(0s-Pj)] 

1 +exp[(es-Pi)] 


(1) 


where: 

P = probability, 

Xts  = the  response  of  student  s to  math  item  i, 

6S  = the  estimated  ability  of  student  s,  and 

fit  = the  estimated  difficulty  of  math  item  i (DeMars,  2010). 

We  chose  the  more  parsimonious  1PL  Rasch  model  because  it  appears  to  fit  these  data 
well,  and  also  because  we  had  a large  final  item  bank  of  CCSS  math  items  (full  CCSS  item  bank) 
for  grades  K-5,  which  we  analyzed  for  functioning  and  used  to  construct  the  operational 
easyCBM  test  forms.  In  other  words,  we  had  a surplus  of  items  from  which  to  construct  test 
forms,  enabling  us  to  eliminate  those  items  that  did  not  function  well  from  the  full  CCSS  item 
bank. 


Test  form  creation.  Within  each  of  grades  K-5,  we  constructed  13  alternate  test  forms 
designed  to  be  of  comparable  difficulty  (3  to  be  used  as  seasonal  benchmark  screening  tests  and 
10  to  be  used  as  progress  monitoring  tests)  to  make  up  the  CCSS  Math  portion  of  the  easyCBM 
formative  assessment  system.  All  test  forms  consisted  of  items  that  appeared  to  function  well, 
while  counterbalancing  CCSS  domain  representation  within  and  across  each  grade  level  form  as 
possible.  To  construct  the  test  forms,  we  first  eliminated  all  items  from  the  full  CCSS  item  hank 
that  appeared  to  not  fit  the  1PL  Rasch  model  with  regard  to  estimated  mean  square  outfit. 

Wright  and  Linacre  (1994)  simulated  and  analyzed  hundreds  of  datasets,  recommending  that 
mean  square  outfit  values  between  0.5  and  1.5  could  be  interpreted  as  productive  for 
measurement  purposes  for  multiple-choice  test  construction,  with  values  >2.0  considered 
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degrading  to  the  measurement  system.  As  an  initial  step  in  test  form  construction,  we  thus 
eliminated  any  item  from  contention  that  had  mean  square  outfit  smaller  than  0.49  or  greater  than 
1.49. 

After  eliminating  such  items,  within  each  grade  we  sorted  the  remaining  items  in 
ascending  order  by  the  associated  CCSS  domain  and  the  estimated  difficulty  of  items  (easiest  to 
most  difficult).  Within  each  grade,  there  were  either  4 (grades  1 and  2)  or  5 (grades  K,  3-5) 
CCSS  domains  we  attempted  to  counterbalance  within  and  across  test  forms.  Thus,  we 
attempted  to  select  the  same  number  of  items  from  each  CCSS  domain  across  the  13  test  forms  at 
a given  grade  level,  though  this  was  not  possible  in  all  instances,  as  some  CCSS  domains  were 
underrepresented  relative  to  others.  To  accomplish  counterbalancing  CCSS  domain 
representation  while  maintaining  form  comparability,  we  selected  sets  of  13  items  of  roughly 
comparable  difficulty.  We  sought  a range  of  difficulty  between  these  selected  item  sets, 
including  items  with  “reach”  into  the  easier  end  of  the  difficulty  spectrum,  being  cognizant  that 
the  operational  tests  would  be  used  to  assess  diverse  student  populations,  from  both  the  special 
education  and  general  education  populations,  within  an  RTI  framework.  In  terms  of  the  layout 
of  selected  math  items  within  test  forms,  we  clustered  items  within  CCSS  domain,  and  then 
ordered  them  from  easiest  to  most  difficult.  We  reasoned  that  construct-irrelevant  variance 
would  likely  be  lessened  if  students  were  jumping  between  domains  less  often,  and  if  the  math 
skill  requirements  of  problems  “ramped  up”  from  lower-  to  higher-order  within  each  domain. 

The  final  step  in  the  test  fonn  creation  process  was  our  selection  of  horizontal  anchor 
items  between  grade  level  seasonal  benchmarks  to  allow  for  within-year  growth  estimation,  and 
vertical  anchors  between  seasonal  benchmarks  across  grades  as  a basis  for  constructing  a 
developmental  scale  score  after  the  2013-2014  academic  year.  The  same  team  of  four 
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researchers  who  selected  anchors  during  piloting,  selected  anchor  items  for  the  operational  test 
forms  using  the  same  process  and  guidelines  previously  described  because  they  were  intimately 
familiar  with  the  math  items  and  the  item/test  development  process. 

We  selected  horizontal  anchor  items  for  each  benchmark  using  a within- grade  linking 
design.  Within  each  grade,  5 horizontal  anchors  were  selected  to  link  the  fall  and  winter 
benchmarks,  and  5 to  link  the  winter  and  spring;  thus,  each  fall  and  spring  benchmark  test  form 
had  5 horizontal  anchor  items,  while  the  winter  test  had  10.  Horizontal  anchor  items  were 
selected  from  those  items  already  making  up  the  benchmark  tests  at  that  point  in  the  test  form 
creation  process.  At  this  point,  we  had  constructed  13  test  forms  designed  to  be  of  comparable 
difficulty  in  each  of  grades  K-5,  each  test  form  consisting  of  25  (grades  K-2)  or  30  (grades  3-5) 
math  items. 

We  then  selected  vertical  anchor  items  from  the  constructed  test  forms,  adding  5 (grade 
K)  or  10  (grades  1-5)  math  items  to  the  end  of  each  benchmark  test  in  a manner  that  linked 
adjacent  grade  level  benchmarks  of  the  same  season.  For  example,  we  selected  5 first  grade 
math  items  from  the  fall  benchmark  to  add  on  to  the  end  of  the  fall  Kindergarten  benchmark 
(linking  fall  grade  K to  fall  grade  1).  When  a grade  was  adjacent  to  two  other  grades  (i.e.,  grade 
3 is  adjacent  to  both  grades  2 and  4),  additional  vertical  anchors  were  appended  to  the  end  of  the 
seasonal  benchmark  test  forms.  For  example,  the  third  grade  fall  benchmark  included  5 vertical 
anchor  items  from  the  second  grade  fall  benchmark  and  5 items  from  the  fourth  grade  fall 
benchmark.  Within  each  test  form,  adjacent  grade-level  vertical  anchor  items  were  ordered  from 
easiest  to  most  difficult  based  on  the  estimated  difficulty  of  each  item  - the  same  manner  in 
which  unique  and  horizontal  anchor  items  were  ordered  with  respect  to  CCSS  domain  - and 
were  appended  to  the  end  of  each  seasonal  benchmark  in  the  order  of  subsequent  and  then  prior 
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grade,  respectively.  This  pattern  of  vertical  anchor  linking  prior  and  adjacent  grades  continued 
for  all  seasonal  benchmarks  for  each  of  grades  K-5  (and  also  grades  6-8,  though  those  results  are 
not  included  in  this  series  of  technical  reports).  Student  responses  to  vertical  anchor  items  over 
the  2013-2014  academic  year  will  serve  as  the  basis  for  constructing  a cross-grade 
developmental  scale  as  we  move  toward  the  reporting  of  a scale  score  in  future  years. 

Results 

As  a result  of  item  development  and  test  creation  efforts  described  in  this  study,  we 
constructed  13  alternate  test  forms:  3 designated  for  seasonal  benchmarking  and  10  designated 
for  progress  monitoring,  in  each  of  grades  K-5.  We  designed  the  test  forms  to  be  aligned  with 
the  CCSS  in  mathematics,  to  be  of  comparable  difficulty  within  grade,  and  to  be  accessible  for 
diverse  student  populations  with  a wide  range  of  achievement.  We  loaded  K-5  tests  into  the 
easyCBM  database  for  use  as  online  formative  CCSS  math  assessments  and  released  them  for 
use  in  fall  2013. 

The  results  of  our  analyses  are  reported  separately  by  grade  (K-5),  each  in  its  own 
technical  report.  For  third  grade,  each  seasonal  benchmark  consists  of  40  total  math  items, 
including  5 vertical  anchor  items  linked  to  each  of  the  respective  grade  2 and  grade  4 
benchmarks.  Each  progress-monitoring  test  form  consists  of  30  unique  math  items.  The  item 
difficulties  for  each  of  the  13  third  grade  test  forms  are  displayed  in  Table  4. 

Item  Statistics 

We  present  the  results  of  the  1PL  Rasch  analysis  in  ascending  order  by  test  form  and  for 
the  full  CCSS  third  grade  item  hank  in  Appendices  B and  D,  respectively.  When  examining  item 
information  in  these  appendices,  it  is  important  to  highlight  two  statistics  critical  to  evaluating 
item  functioning  within  the  context  of  Rasch-based  test  development:  the  estimated  difficulty  and 
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indicator  of  discrimination.  The  difficulty  parameter,  in  equation  1,  represents  the  estimation 
of  how  difficult  item  i is  relative  to  all  other  items  in  the  analytic  sample,  with  approximate 
possible  values  ranging  from  -3  (easiest  items)  to  +3  (most  difficult  items)  in  the  standardized 
scale  - the  same  scale  on  which  student  ability  ( 0S ) is  reported  (DeMars,  2010).  An  estimated 
difficulty  equal  to  0 could  then  be  interpreted  as  a student  with  average  ability  would  have  an 
equal  probability  of  getting  the  answer  correct  as  incorrect.  Individual  item  difficulties  are 
averaged  across  forms,  representing  an  average  difficulty  of  each  test  form  as  displayed  in  Table 
4,  to  evaluate  fonn  equivalence.  The  average  difficulty  across  all  13  third  grade  test  forms  is 
0.236  (range  = 0.206  to  0.271),  or  slightly  above  average  difficulty. 

The  second  statistic  that  warrants  highlighting  is  the  indicator  of  item  discrimination.  As 
noted  earlier,  the  1PL  Rasch  analysis  constrains  the  discrimination  parameter  to  1.0  (DeMars, 
2010;  Linacre,  2008).  Though  discrimination  statistics  are  included  for  each  item  in  Appendices 
B and  D,  it  is  important  to  distinguish  that  this  item  statistic  is  not  a true  estimation  of  item 
discrimination,  but  rather  an  rough  indicator  of  item  discrimination,  approximated  during  a post- 
hoc  calculation  by  WINSTEPS  (Linacre,  2008).  Interpretation  of  discrimination  values  in  1PL 
Rasch  analysis  is  the  same  as  those  freely  estimated  in,  for  example,  a 2-parameter  logistic 
model;  though,  caution  is  warranted  given  they  are  merely  rough  indicators  in  this  study. 
Discrimination  values  >1.2  are  considered  very  high  (more  productive  for  measurement 
purposes),  while  values  < 0.5  are  considered  very  low,  when  item  difficulty  and  student  ability 
are  estimated  in  the  standardized  scale  (DeMars,  2010),  as  is  the  case  in  our  analysis. 

Distractor  Analysis 

We  present  response  option  statistics  in  ascending  order  by  test  form  and  for  the  full 
CCSS  third  grade  item  hank  in  Appendices  C and  E,  respectively.  Interpretation  of  statistics 
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within  these  appendices  is  similar  to  item  level  interpretation,  but  is  presented  for  each  of  the 
three  response  options.  We  coded  the  correct  response  option  as  A for  all  items,  while  the  * 
represents  missing  data  (those  students  included  in  the  analytic  sample  who  did  not  respond  to 
the  given  item  either  by  choice,  if  administered  the  pilot  fonn  containing  the  item,  or  simply 
because  they  were  not  administered  that  form).  We  analyzed  distractors,  seeking  to  retain  well- 
functioning items  in  which  students  with  the  highest  average  estimated  ability  selected  the 
correct  answer  choice,  thus  demonstrating  the  highest  average  person  measure,  while  students 
with  lower  average  estimated  ability  selected  one  of  the  remaining  answer  options.  As  described 
earlier,  we  attempted  to  write  items  with  one  near  distractor  and  one  far  distractor.  Items 
functioning  well  would  thus  demonstrate  near  distractors  with  average  person  measure  values 
slightly  below  that  of  the  correct  response  option  and  far  distractors  with  lower  average  person 
measure  values. 

Discussion 

As  instruction  in  public  schools  across  the  United  States  moves  in  closer  alignment  with 
the  CCSS,  it  is  important  for  formative  student  assessment  to  also  move  in  that  direction  given 
that  the  results  of  such  assessment  are  regularly  used  to  inform  instructional  decision-making 
within  RTI  contexts.  To  a growing  degree,  the  validity  of  instructional  decision-making  in  these 
contexts  depends  on  both  the  alignment  between  adopted  fonnative  assessments  and  the  CCSS 
and  also  the  technical  adequacy  of  such  assessments.  In  this  series  of  technical  reports,  we 
described  the  development  and  scaling  of  the  easyCBM  CCSS  Math  assessments  for  grades  K-5, 
designed  for  use  within  an  RTI  framework  of  instruction  and  formative  assessment  in  elementary 


classrooms. 
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Table  1 


Third  Grade  Item  Writing  Plan  by  CCSS  Standard 


CCSS 

Standard 

Item  Set  1 

Item  Set  2 

Item  Set  3 

Item  Set  4 

Existing 
BM  Align 

Total 

OA1 

5 

5 

5 

5 

3 

20 

OA2 

0 

0 

0 

0 

5 

0 

OA3 

0 

0 

0 

0 

6 

0 

OA4 

5 

5 

5 

5 

4 

20 

OA5 

5 

5 

5 

5 

2 

20 

OA6 

5 

5 

5 

5 

3 

20 

OA7 

0 

0 

0 

0 

5 

0 

OA8 

5 

5 

5 

5 

3 

20 

OA9 

0 

0 

0 

0 

5 

0 

NBT1 

8 

9 

9 

8 

0 

34 

NBT2 

9 

8 

8 

8 

0 

33 

NBT3 

8 

8 

8 

9 

1 

33 

NF1 

0 

0 

0 

0 

11 

0 

NF2 

20 

20 

20 

20 

1 

80 

NF3 

5 

5 

5 

5 

5 

20 

MD1 

3 

3 

3 

4 

0 

13 

MD2 

4 

3 

3 

3 

0 

13 

MD3 

3 

3 

4 

3 

0 

13 

MD4 

3 

4 

3 

3 

0 

13 

MD5 

3 

3 

3 

3 

0 

12 

MD6 

3 

3 

3 

3 

1 

12 

MD7 

3 

3 

3 

3 

0 

12 

MD8 

3 

3 

3 

3 

1 

12 

G1 

20 

20 

20 

20 

4 

80 

G2 

5 

5 

5 

5 

15 

20 

Set  total 

125 

125 

125 

125 

75 

500 

Note.  Item  Sets  1-4  reflect  items  written  to  each  CCSS  standard  based  on  results  from  our 
previous  alignment  study  (Park  et  al.,  2012),  reflected  in  Existing  BM  Align  column.  Total 
represents  the  number  of  math  items  written  to  a given  CCSS  standard  in  the  current  study. 
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Table  2 


Grades  3-5  Piloting  Plan 


Form 

Cl 

C2 

C3 

C4 

C5 

C6 

C7 

C8 

C9 

CIO 

Cll 

C12 

C13 

C14 

C15 

Anchor 

Unique 

Total 

1 

5 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

5 

31 

36 

2 

3 

2 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

31 

36 

3 

- 

2 

3 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

31 

36 

4 

- 

- 

3 

2 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

31 

36 

5 

- 

- 

- 

2 

3 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

31 

36 

6 

- 

- 

- 

- 

3 

2 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

31 

36 

7 

- 

- 

- 

- 

- 

2 

3 

- 

- 

- 

- 

- 

- 

- 

- 

3 

31 

36 

8 

- 

- 

- 

- 

- 

- 

3 

2 

- 

- 

- 

- 

- 

- 

- 

2 

31 

36 

9 

- 

- 

- 

- 

- 

- 

- 

2 

3 

- 

- 

- 

- 

- 

- 

3 

31 

36 

10 

- 

- 

- 

- 

- 

- 

- 

- 

3 

2 

- 

- 

- 

- 

- 

2 

31 

36 

11 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

3 

- 

- 

- 

- 

3 

31 

36 

12 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

2 

- 

- 

- 

2 

31 

36 

13 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

3 

- 

- 

3 

31 

36 

14 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

2 

- 

2 

31 

36 

15 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

3 

0 

31 

36 

Form 

N1 

N2 

N3 

N4 

N5 

N6 

N7 

N8 

N9 

N10 

Nil 

N12 

N13 

N14 

N15 

Anchor 

Unique 

Total 

1 

5 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

5 

31 

36 

2 

2 

3 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

31 

36 

3 

- 

3 

2 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

31 

36 

4 

- 

- 

2 

3 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

31 

36 

5 

- 

- 

- 

3 

2 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

31 

36 

6 

- 

- 

- 

- 

2 

3 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

31 

36 

7 

- 

- 

- 

- 

- 

3 

2 

- 

- 

- 

- 

- 

- 

- 

- 

2 

31 

36 

8 

- 

- 

- 

- 

- 

- 

2 

3 

- 

- 

- 

- 

- 

- 

- 

3 

31 

36 

9 

- 

- 

- 

- 

- 

- 

- 

3 

2 

- 

- 

- 

- 

- 

- 

2 

31 

36 

10 

- 

- 

- 

- 

- 

- 

- 

- 

2 

3 

- 

- 

- 

- 

- 

3 

31 

36 

11 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

2 

- 

- 

- 

- 

2 

31 

36 

12 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

3 

- 

- 

- 

3 

31 

36 

13 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

2 

- 

- 

2 

31 

36 

14 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

3 

- 

3 

31 

36 

15 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

2 

0 

31 

36 

Note.  C = CCSS  pool  anchor  item;  N = NCTM  pool  anchor  item.  Anchor  items  appearing  in  a vertical  column  (both  CCSS  or 
NCTM)  were  shared  between  the  specified  forms.  For  example,  fonn  3 and  form  4 shared  3 anchor  items  from  the  CCSS  pool  (set 
C3)  and  2 from  the  NCTM  pool  (set  N3). 
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Table  3 


Grades  K-5  Piloting  Participation  Statistics 


Grade  K 

Grade  1 

Grade  2 

Form 

Completed 

Form 

Completed 

Form 

Completed 

1 

48 

55 

1 

77 

84 

1 

97 

110 

2 

48 

51 

2 

70 

79 

2 

72 

251 

3 

50 

57 

3 

78 

102 

3 

85 

96 

4 

49 

56 

4 

87 

114 

4 

69 

76 

5 

48 

52 

5 

70 

77 

5 

66 

78 

6 

48 

52 

6 

70 

85 

6 

66 

78 

7 

48 

52 

7 

73 

82 

7 

66 

73 

8 

50 

52 

8 

72 

93 

8 

70 

80 

9 

50 

55 

9 

76 

85 

9 

89 

95 

10 

48 

51 

10 

73 

86 

10 

79 

88 

11 

52 

81 

11 

73 

87 

11 

75 

85 

12 

48 

54 

12 

86 

89 

12 

80 

104 

13 

47 

58 

13 

80 

99 

13 

69 

82 

14 

49 

70 

14 

70 

116 

14 

84 

85 

15 

48 

52 

15 

69 

77 

15 

69 

71 

Form  Average 

49 

57 

Form  Average 

75 

90 

Form  Average 

76 

97 

Grade  3 

Grade  4 

Grade  5 

Form 

Completed 

Form 

Completed 

Form 

Completed 

1 

107 

250 

1 

104 

118 

1 

97 

135 

2 

107 

197 

2 

94 

112 

2 

110 

132 

3 

114 

128 

3 

89 

101 

3 

99 

123 

4 

118 

159 

4 

103 

115 

4 

95 

143 

5 

122 

139 

5 

119 

141 

5 

93 

102 

6 

114 

128 

6 

89 

95 

6 

99 

156 

7 

122 

146 

7 

91 

103 

7 

97 

110 

8 

110 

266 

8 

91 

111 

8 

118 

152 

9 

106 

115 

9 

104 

121 

9 

116 

133 

10 

106 

123 

10 

110 

118 

10 

103 

128 

11 

109 

116 

11 

89 

104 

11 

93 

113 

12 

119 

146 

12 

89 

118 

12 

100 

142 

13 

109 

170 

13 

103 

110 

13 

100 

121 

14 

116 

192 

14 

108 

232 

14 

111 

139 

15 

106 

136 

15 

116 

138 

15 

94 

105 

Form  Average 

112 

161 

Form  Average 

100 

122 

Form  Average 

102 

129 

Note.  Many  test  forms  were  started  though  not  completed,  thus,  the  number  of  student  responses  per  item  varies  within  form,  as  shown  in  Appendices  B and  D. 
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Table  4 


Third  Grade  Item  Difficulties  by  Test  Form  (without  adjacent  grade  vertical  anchor  items) 


Item  # 

PM1 

PM2 

PM3 

PM4 

PM5 

PM6 

PM7 

PM8 

PM9 

PM  10 

BMF 

BMW 

BMS 

Mean 

1 

-0.56 

-0.99 

-0.67 

-0.94 

-0.91 

-0.89 

-0.72 

-0.95 

-0.58 

-1.00 

-1.15 

-1.10 

-1.08 

-0.888 

2 

0.82 

0.78 

0.75 

0.67 

0.69 

0.73 

0.61 

0.63 

0.63 

0.66 

0.86 

0.86 

0.88 

0.736 

3 

1.36 

1.53 

1.66 

1.61 

1.31 

1.62 

1.30 

1.40 

1.28 

1.69 

1.44 

1.42 

1.40 

1.463 

4 

-0.83 

-0.68 

-0.38 

-0.29 

-0.15 

-0.07 

-0.24 

-0.28 

-0.53 

-0.59 

-0.95 

-0.94 

-0.98 

-0.532 

5 

0.60 

0.60 

0.61 

0.62 

0.66 

0.73 

0.76 

0.79 

0.91 

0.88 

0.81 

0.82 

0.83 

0.740 

6 

1.51 

1.55 

1.58 

1.65 

1.70 

1.70 

1.85 

1.89 

1.89 

1.90 

1.47 

1.47 

1.47 

1.664 

7 

-1.74 

-1.69 

-1.74 

-1.68 

-1.74 

-1.76 

-1.77 

-1.77 

-1.79 

-1.79 

-1.71 

-1.71 

-1.71 

-1.738 

8 

-1.28 

-1.26 

-1.29 

-1.24 

-1.29 

-1.23 

-1.21 

-1.20 

-1.18 

-1.17 

-1.27 

-1.27 

-1.27 

-1.243 

9 

-0.70 

-0.72 

-0.76 

-0.78 

-0.78 

-0.79 

-0.79 

-0.80 

-0.82 

-0.82 

-0.69 

-0.69 

-0.69 

-0.756 

10 

-0.35 

-0.34 

-0.34 

-0.33 

-0.32 

-0.33 

-0.31 

-0.31 

-0.30 

-0.29 

-0.38 

-0.38 

-0.36 

-0.334 

11 

0.36 

0.43 

0.34 

0.36 

0.38 

0.34 

0.46 

0.46 

0.45 

0.45 

0.32 

0.32 

0.31 

0.383 

12 

0.85 

0.88 

0.91 

0.89 

0.96 

0.89 

0.97 

0.91 

0.92 

0.99 

0.86 

0.86 

0.86 

0.904 

13 

1.38 

1.39 

1.40 

1.40 

1.42 

1.44 

1.47 

1.49 

1.50 

1.52 

1.54 

1.53 

1.53 

1.462 

14 

-1.54 

-1.53 

-1.50 

-1.50 

-1.47 

-1.42 

-1.41 

-1.41 

-1.39 

-1.47 

-1.44 

-1.44 

-1.45 

-1.459 

15 

-1.19 

-1.17 

-1.14 

-1.12 

-1.07 

-1.07 

-1.15 

-1.09 

-1.14 

-1.10 

-1.18 

-1.18 

-1.18 

-1.137 

16 

-0.81 

-0.83 

-0.75 

-0.83 

-0.78 

-0.77 

-0.87 

-0.89 

-0.86 

-0.72 

-0.73 

-0.74 

-0.74 

-0.794 

17 

-0.22 

-0.24 

-0.26 

-0.30 

-0.31 

-0.31 

-0.26 

-0.33 

-0.33 

-0.34 

-0.21 

-0.21 

-0.21 

-0.272 

18 

0.17 

0.17 

0.20 

0.19 

0.27 

0.26 

0.29 

0.26 

0.29 

0.25 

0.22 

0.22 

0.23 

0.232 

19 

1.22 

1.35 

1.41 

1.20 

1.41 

1.18 

1.19 

1.54 

1.46 

1.54 

1.22 

1.28 

1.28 

1.329 

20 

3.10 

2.96 

2.73 

2.74 

2.99 

2.97 

2.97 

3.09 

3.16 

2.67 

3.13 

3.13 

3.14 

2.983 

21 

-1.21 

-1.19 

-1.17 

-1.21 

-1.22 

-1.15 

-1.13 

-1.14 

-1.13 

-1.17 

-1.24 

-1.24 

-1.23 

-1.187 

22 

-0.89 

-0.90 

-0.90 

-0.87 

-0.84 

-0.85 

-0.84 

-0.84 

-0.83 

-0.84 

-0.89 

-0.89 

-0.89 

-0.867 

23 

-0.55 

-0.54 

-0.53 

-0.54 

-0.53 

-0.53 

-0.52 

-0.49 

-0.49 

-0.48 

-0.47 

-0.47 

-0.46 

-0.508 

24 

0.45 

0.44 

0.46 

0.45 

0.45 

0.46 

0.46 

0.48 

0.46 

0.48 

0.48 

0.48 

0.48 

0.464 

25 

0.72 

0.72 

0.71 

0.71 

0.71 

0.73 

0.76 

0.75 

0.75 

0.75 

0.72 

0.72 

0.72 

0.728 

26 

1.35 

1.35 

1.38 

1.38 

1.36 

1.40 

1.39 

1.38 

1.39 

1.41 

1.34 

1.34 

1.34 

1.370 

27 

2.38 

2.18 

2.12 

2.13 

2.21 

2.32 

2.21 

2.34 

2.25 

2.14 

2.46 

2.40 

2.40 

2.272 

28 

0.10 

0.11 

0.18 

0.20 

0.14 

0.10 

0.20 

0.29 

0.26 

0.30 

0.24 

0.24 

0.25 

0.201 

29 

0.79 

0.78 

0.73 

0.76 

0.72 

0.72 

0.69 

0.70 

0.68 

0.69 

0.84 

0.82 

0.82 

0.749 

30 

1.06 

1.05 

1.02 

1.13 

1.14 

1.15 

1.17 

1.17 

1.22 

1.24 

1.06 

1.06 

1.09 

1.120 

Mean 

0.212 

0.206 

0.225 

0.215 

0.237 

0.252 

0.251 

0.269 

0.271 

0.259 

0.223 

0.224 

0.226 

0.236 

Note.  PM1  to  PM10  = Progress  Monitoring  Form  1 to  Form  10;  BMF  = Benchmark  Fall,  BMW  = Benchmark  Winter,  BMS  = Benchmark  Spring; 
Green  = horizontal  anchor  items. 
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Appendix  A:  Training 


Appendix  A:  Training  Materials 
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Appendix  A:  Training 


Common  Core  State  Standards  (CCSS) 
Math  Item  Writing  and  Review 

Supplementing  the  easyCBM  math 
assessment  system 


easyCBM 

• easyCBM  is  an  online  benchmark  and  progress 
monitoring  assessment  system. 

• Designed  to  inform  teachers'  classroom-based 
instructional  decisions 

• Used  within  Response  to  Intervention  (RTI) 
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Appendix  A:  Training 


easyCBM  in  Use 

• What  are  your  experiences  with  easyCBM? 

Popularity  of  the  System 

• Registered  users  in  all  50  states 

• Over  2 million  students  in  the  system 

• Over  800,000  teachers  in  the  system 

• Growing  exponentially 

• Over  9000  new  registered  teacher  users  every 
month;  with  district-level  subscribers  growing 


Within  RTI  (very  general) 


Standards,  instruction  and  assessment  must  align 
for  accurate  decision-making  and  inferences! 


easyCBM  CCSS  Third  Grade  Math  Measure  Development 


31 

Appendix  A:  Training 


Item 


Before  we  get  too  far: 
Vocabulary 


(Question) 

Stem 


Project  Overview 

• Develop  3,000  new  math  items  for  easyCBM 
in  grades  K-5;  500  items  per  grade 

- Aligned  with  the  Common  Core  State  Standards 
(CCSS) 

- Piloted  in  April/May  to  examine  their  technical 
adequacy  and  establish  difficulty 

— Developed  items  will  be  assembled  with  existing 
items  that  were  aligned  to  CCSS  into  20  test  forms 
per  grade  (60  forms  total). 

- Each  form  will  have  25  items  for  use  in  easyCBM 

- Anticipated  release  date  of  Fall  2013 
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Appendix  A:  Training 


Existing  Items  vs.  Items  to  be  Developed 

Existing  Items 

Items  to  be  Developed 

• Originally  developed  for  the 

• Should  be  developed  for 

2%  population  (i.e., 

students  performing  at  or 

students  performing  well 

slightly  below  grade-level 

below  grade-level 

expectations. 

expectations) 

• Aligned  to  the  NCTM  Focal 
Point  Standards 

• Aligned  to  the  CCSS 

Common  Core  Standards  (see  PDF) 

Grade  K 

Standard  Domains 

• Counting  and  Cardinality  (KCC) 

• Operations  and  Algebraic  Thinking  (KOA) 

• Number  and  Operations  in  Base  Ten  (KNBT) 

• Measurement  and  Data  (KMD) 

• Geometry  (KG) 

24  standards  divided  among  5 domains. 
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Appendix  A:  Training 


Outline  of  GrK  Items  to  be  Written/Reviewed 


Item  Set  2 

Item  Set  3 

Item  Set  4 

Item  Set  5 

CCSS  B M Alien 

Total 

CCl 

5 

5 

6 

6 

0 

22 

CC2 

1 

1 

1 

1 

6 

4 

CC3 

6 

6 

5 

5 

1 

22 

CC4 

1 

1 

1 

1 

5 

4 

CCS 

5 

5 

6 

6 

3 

22 

CC6 

1 

1 

1 

1 

5 

4 

CC7 

6 

6 

5 

5 

2 

22 

SI 

1 

1 

1 

1 

6 

4 

G2 

1 

1 

1 

1 

7 

4 

S3 

10 

10 

11 

11 

2 

42 

G4 

1 

1 

1 

1 

5 

4 

G5 

11 

11 

10 

10 

0 

42 

G6 

1 

1 

1 

1 

8 

4 

MD1 

4 

4 

4 

4 

5 

16 

MD2 

2 

2 

2 

2 

9 

8 

MD3 

19 

19 

19 

19 

4 

76 

NBT1 

25 

25 

25 

25 

1 

100 

DAI 

5 

5 

5 

5 

3 

20 

DA2 

5 

5 

5 

5 

3 

20 

0A3 

5 

5 

5 

5 

0 

20 

OA4 

5 

5 

5 

5 

1 

20 

OA5 

5 

5 

5 

5 

3 

20 

Set  Total 

125 

125 

125 

125 

500 

Common  Core  Standards  (see  PDF) 

Grade  1 

Standard  Domains 

• Operations  and  Algebraic  Thinking  (10A) 

• Number  and  Operations  in  Base  Ten  (1NBT) 

• Measurement  and  Data  (1MD) 

• Geometry  (1G) 


21  standards  divided  among  4 domains. 
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Appendix  A:  Training 


Outline  of  Grl  Items  to  be  Written/Reviewed 


hem  Set  2 

hem  Set  3 

hem  Set  4 

hem  Set  5 

CCSS  B M Alien 

Total 

61 

10 

10 

10 

10 

4 

40 

62 

10 

10 

10 

10 

63 

12 

11 

11 

11 

1 

45 

MD1 

8 

8 

8 

8 

1 

32 

MD2 

8 

8 

8 

8 

0 

32 

MD3 

8 

8 

8 

8 

0 

32 

MM 

7 

7 

7 

8 

3 

29 

NBT2 

1 

2 

1 

1 

5 

5 

NBT3 

10 

10 

10 

10 

2 

40 

NBT3 

10 

10 

10 

10 

0 

40 

NBT6 

10 

10 

10 

10 

0 

40 

OA2 

6 

6 

7 

6 

4 

25 

044 

6 

6 

6 

7 

1 

25 

0A3 

6 

7 

6 

6 

1 

25 

0A7 

6 

6 

7 

6 

0 

25 

0A8 

7 

6 

6 

6 

3 

25 

Set  Total 

125 

125 

125 

125 

500 

Common  Core  Standards  (see  PDF) 

Grade  2 

Standard  Domains 

• Operations  and  Algebraic  Thinking  (20A) 

• Number  and  Operations  in  Base  Ten  (2NBT) 

• Measurement  and  Data  (2MD) 

• Geometry  (2G) 


26  standards  divided  among  4 domains. 


easyCBM  CCSS  Third  Grade  Math  Measure  Development 


35 

Appendix  A:  Training 


Outline  of  Gr2  Items  to  be  Written/Reviewed 

hem  Set  2 

Item  Set  3 

Hem  Set  4 

hem  Set  5 

CCSS  BM  Alien 

Total 

si 

10 

10 

11 

11 

0 

42 

G2 

10 

11 

10 

10 

3 

41 

S3 

11 

11 

10 

10 

0 

42 

MD2 

3 

3 

3 

3 

3 

12 

MD3 

4 

3 

4 

4 

0 

15 

MD4 

3 

4 

4 

4 

0 

15 

WD5 

4 

4 

4 

3 

0 

15 

MD6 

3 

3 

3 

4 

2 

13 

>4  07 

3 

3 

3 

3 

3 

12 

MD8 

4 

3 

3 

3 

2 

13 

MD9 

3 

4 

4 

4 

0 

15 

MD10 

4 

4 

4 

3 

0 

15 

NBT2 

5 

5 

5 

5 

0 

20 

•4BT3 

5 

5 

5 

5 

0 

20 

NBT5 

1 

1 

1 

2 

5 

5 

NBT6 

5 

5 

5 

5 

0 

20 

NBT7 

5 

5 

5 

5 

2 

20 

NBT8 

5 

5 

5 

5 

2 

20 

NBT9 

5 

5 

5 

5 

0 

20 

OA1 

2 

1 

1 

1 

7 

5 

QA2 

10 

10 

10 

10 

3 

40 

OA3 

10 

10 

10 

10 

0 

40 

OA4 

10 

10 

10 

10 

1 

40 

125 

125 

125 

125 

500 

Common  Core  Standards  (see  PDF) 

Grade  3 

Standard  Domains 

• Operations  and  Algebraic  Thinking  (30A) 

• Number  and  Operations  in  Base  Ten  (3NBT) 

• Number  and  Operations-Fractions  (3NF) 

• Measurement  and  Data  (3MD) 

• Geometry  (3G) 

25  standards  divided  among  5 domains. 
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Appendix  A:  Training 


Outline  of  Gr3  Items  to  be  Written/Reviewed 


Item  Set  2 

Item  Set  3 

Item  Set  4 

Item  Set  5 

CCSS  BM  Alien 

Total 

OAl 

5 

5 

5 

5 

3 

20 

OA4 

5 

5 

5 

5 

4 

20 

OA5 

5 

5 

5 

5 

2 

20 

OA6 

5 

5 

5 

5 

3 

20 

OA8 

5 

5 

5 

5 

3 

20 

NBT1 

8 

9 

9 

8 

0 

34 

NBT2 

9 

8 

8 

8 

0 

33 

NBT3 

8 

8 

8 

9 

1 

33 

NF2 

20 

20 

20 

20 

1 

SO 

NF3 

5 

5 

5 

5 

5 

20 

MD1 

3 

3 

3 

4 

0 

13 

MD2 

4 

3 

3 

3 

0 

13 

MD3 

3 

3 

4 

3 

0 

13 

MD4 

3 

4 

3 

3 

0 

13 

MD5 

3 

3 

3 

3 

0 

12 

MD6 

3 

3 

3 

3 

1 

12 

MD7 

3 

3 

3 

3 

0 

12 

MDfi 

3 

3 

3 

3 

1 

12 

G1 

20 

20 

20 

20 

4 

SO 

62 

5 

5 

5 

5 

15 

20 

125 

125 

125 

125 

500 

Common  Core  Standards  (see  PDF) 

Grade  4 

Standard  Domains 

• Operations  and  Algebraic  Thinking  (40A) 

• Number  and  Operations  in  Base  Ten  (4NBT) 

• Number  and  Operations-Fractions  (4NF) 

• Measurement  and  Data  (4MD) 

• Geometry  (4G) 

28  standards  divided  among  5 domains. 
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Appendix  A:  Training 


Outline  of  Gr4  Items  to  be  Written/Reviewed 


Common  Core  Standards  (see  PDF) 

Grade  5 

Standard  Domains 

• Operations  and  Algebraic  Thinking  (50A) 

• Number  and  Operations  in  Base  Ten  (5NBT) 

• Number  and  Operations-Fractions  (5NF) 

• Measurement  and  Data  (5MD) 

• Geometry  (5G) 

26  standards  divided  among  5 domains. 
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Appendix  A:  Training 


Outline  of  Gr5  Items  to  be  Written/Reviewed 


Item  Set  2 

Hem  Set  3 

Hem  Set  4 

Item  Set  5 

CCSS  BM  Alien 

Total 

OAl 

9 

9 

8 

8 

1 

34 

OA2 

8 

8 

8 

9 

0 

33 

0A3 

8 

8 

9 

8 

0 

33 

NBT1 

3 

4 

4 

4 

2 

15 

NBT2 

4 

4 

4 

3 

2 

15 

NBT3 

5 

5 

5 

5 

0 

20 

NBT4 

4 

3 

4 

4 

2 

15 

NBT5 

5 

5 

5 

5 

0 

20 

NBT6 

4 

4 

3 

4 

3 

15 

NF2 

3 

4 

4 

4 

2 

15 

NF3 

5 

5 

5 

5 

0 

20 

NF4 

4 

4 

4 

3 

1 

15 

KF5 

S 

5 

5 

5 

0 

20 

f»F6 

4 

4 

3 

4 

1 

15 

NF7 

4 

3 

4 

4 

2 

15 

MD1 

7 

7 

8 

8 

0 

30 

M02 

8 

8 

7 

7 

0 

30 

M04 

5 

5 

5 

5 

3 

20 

M05 

S 

5 

5 

5 

4 

20 

G1 

7 

6 

6 

6 

0 

25 

G2 

6 

6 

6 

7 

0 

25 

G3 

6 

6 

7 

6 

0 

25 

G4 

6 

7 

6 

6 

0 

25 

125 

125 

125 

125 

500 

Why  So  Many  New  Items? 

1.  No  matter  how  perfect  an  item  looks,  there 
are  always  quirks. 

- We  need  250-300  "good"  items  per  grade. 

- If  we  write  500  items  per  grade,  we  can  "weed 
out"  the  poor  items. 

2.  The  surplus  of  items  also  allows  us  to 
assemble  items  into  test  forms  (i.e.,  seasonal 
benchmarks  and  progress-monitoring)  of 
comparable  difficulty. 
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Appendix  A:  Training 


Purpose  1 

Example:  Two  Similar  Items 

Item  1 Item  2 


A. 

6 

15 

A.  4 

B. 

8 

p 

B*  18 

C. 

JL 

r, 

C.  1 

Purpose  1 

Example  (continued) 

• Although  the  previous  two  items  look  very 
similar,  our  statistical  analyses  of  the  items 
functioning  indicate  that  Item  1 is  functioning 
quite  well,  while  Item  2 is  functioning  quite 
poorly. 

• Item  2 was  determined  to  be  functioning  poorly 
enough  that  it  was  removed 

• Despite  the  similarities  in  item  construction,  the 
students'  responses  to  the  items  are  very 
different  (i.e.,  matching  student  ability  w/ 
question  difficulty). 
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Appendix  A:  Training 


Purpose  1 
Recap 

Item  1 Item  2 


i*i  = _ 


a.  -Hr  a-  7 

b. {  Good  Item  B -w  Poor  Item 

Why?  It's  difficult  to  say  for  sure,  but  is  part  of  why  we  need  to  write  a 
surplus  of  items 


Purpose  2 
RTI 

• RTI  requires  multiple  test  forms  of  equivalent 
difficulty 

• If  forms  are  not  equivalently  difficult, 
assumptions  about  the  growth  students  make 
and/or  the  effectiveness  of  instruction  or  an 
intervention  may  not  be  accurate 
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Appendix  A:  Training 


Purpose  2 
(Continued) 

• Growth? 

- What  if  first  three 
forms  were  unusually 
difficult  and  the  last 
two  forms  were 
unusually  easy? 

• We  need  to  have  a sufficient  number  of  items 
to  ensure  that  forms  actually  are,  statistically 
speaking,  equivalently  difficult. 


G*«d«  1.  Wo  id  H« ini|  FluMicy:  Jufa  Aton?® 


(•M  Grea* 

£ ifl 

.u,_ • 

• 

sa  - 

/ / s 

D«ta  of  AnainiliHtM 

Or»il  30  nvuimr  on  awcutor 


10PB  • '30PB  SOpb  90p* 


Your  Role  As  the  Item  Writer  and 
Item  Reviewer 

A Concurrent  Process  of  Item 
Writing , Reviewing , and  Submission 
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Appendix  A:  Training 


Your  role  as  the  Item  Writer 

• Become  an  "item  writing  expert" 

- Thoroughly  review  the  CCSS  associated  with  the 
grade-band  you  have  been  assigned  (i.e.,  K-l,  2-3, 
and  4-5). 

- Review  "example  items"  in  ItemSet  spreadsheet. 

• Complete  two  ItemSet  spreadsheets, 
consisting  of  125  items  for  each  grade  of  your 
assigned  grade  band  (i.e.,  125  grade  K items, 
and  125  grade  1 items  for  K-l  grade  band) 

• Thoroughly  review  all  items  written  before 
turning  items  in  to  BRT  (in  batches). 


Your  role  as  the  Item  Reviewer 

• Become  an  "item  writing  expert" 

- Thoroughly  review  the  CCSS  associated  with  the 
grade  that  you  have  been  assigned  (i.e.,  K,  1,  2,  3, 
4,  or  5). 

- Review  "example  items"  in  ItemSet  spreadsheet. 

• Review  and  edit  500  grade-level  items  from 
the  4 ItemSets  (in  batches). 

• Thoroughly  review  all  items  written  before 
turning  items  in  to  BRT  (in  batches,  by 
ItemSet). 
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Excel  ItemSet  Template  cont. 

• Each  ItemSet  consists  of  125  items 

• Item  Writers  will  write  all  125  items  and  fill  out  the 
excel  sheet. 

- After  writing  items  into  the  excel  file,  the  Item  Writer 
should  add  an  underscore  and  their  initials  after  the 
version  number  to  save  it 

• e.g.,  Item  Writer  = Shawn  Irvin: 

G2ltemSet2.xlsx  G2ltemSet2_Sl.xlsx 

• Each  Item  Writer  will  write  items  to  specific  CCSS, 
most  times  multiple  items  per  standard 

• The  number  of  items  per  domain  will  vary  by  Item 
Writer  and  grade. 


Excel  ItemSet  Template 


•rtnv  ■■«!*  f"*  (Mfr  i* r*«i  i*  id'r  ?frtr 


.. Kli-iv1  IhiKi"  Hhtn1  MMn  Mlfim'  ***.*?,  V !! 


emt  •»«»  j wtn»r  o. 


Sir- 


Write  one  Question  (stem)  and  three 

Answer  options  in  these  cells 

• Option  A is  always  the  correct 
answer 

• Options  B and  C are  always 
incorrect,  but  plausible  distractor 
responses 


The  "home"  for  all  of  the  items  we  write  and  review!!! 
These  ItemSet  spreadsheets  will  be  passed  from  Writers  to 
me  to  Reviewers  and  back  to  me  for  an  in-house  review. 
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Appendix  A:  Training 


Item  ID  Naming  Convention 

• It  is  crucial  that  all  items  written  are  filled  out 
in  the  excel  sheet  appropriately 

• Graphics  accompanying  an  item  MUST  BE 
given  the  same  ID  because  the  graphic  is  part 
of  the  item. 

- If  the  wrong  ID  is  assigned  to  the  graphic,  it  will 
either  be  lost  or  accompany  the  wrong  item. 
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Appendix  A:  Training 


Graphics  (images)  in  Items 

• First  rule  of  graphics  - they  are  expensive 

- Adds,  on  average,  around  $50  to  the  total  cost  of  the 
item 

• Does  this  mean  graphics  should  not  be  used? 

- No,  but  it  does  mean  that  graphics  should  only  be  used  if 
they  (a)  increase  the  clarity  of  the  item  or  (b)  are 
essential  to  the  content  of  the  item  (i.e.,  in  geometry) 

- Graphics  may  be  necessary  for  some  standards! 

• There  is  also  no  clear  research  on  the  effect  of 
adding  a graphic  to  an  item  (Kettler,  Elliott,  & 
Beddow,  2009) 


Graphics  in  Items  (cont.) 

• Graphics  can  be  in  question/stem,  and/or  in 
answer  options! 

• If  you  as  an  Item  Writer  or  Reviewer  want  to 
add  graphics,  they  have  two  options: 

1.  Describe  what  the  graphic  will  look  like  in  detail  in 
the  excel  sheet  (recommended  if  the  graphic  is 
simplistic). 

2.  Draw  the  graphic  by  hand  or  use  clipart  from  the 
web  in  the  "Graphics  Template"  provided. 
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Describe  what  the  graphic  will  look  like  in 
detail  in  the  excel  sheet  (recommended  if  the 
graphic  is  simplistic). 

tW«Ttax  >«»•••«■<  P >»«?»•«*'  *i  If**. 

4>mBE5  ftjwagpna  ‘V^inJTTr^ 

M!>  M • 

!C<  i 

»r*»  '*■'» 

*«ra  niMn  mo  » i 

iMunMHtaatnM-  r.rM  « J • rM  'iMn  ll 

otoo 

u**» 

Norbi  r<  •••*'* 

, !»■  r i»— » w »»■ 

nbM 

Protocol  for  Hand  Drawn  Graphics 


• Draw  the  graphic  by  hand  using  "Graphic  Template" 

• Matching  Item  ID  exactly! 


jgmeir^  l tyl  \y- 


J U 


llom_  3 Of 5 & P"9 


© isms  El 
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Protocol  for  Hand  Drawn  Graphics 
(as  it  is  seen  in  easyCBM) 


The  head  is  a 


A.  wangle 

B.  circle 

C.  square 


Protocol  for  Hand  Drawn  Graphics 

• Use  clipart  from  the  web  and  enter  into  "Graphics 
Template" 

http://www.fotosearch.com/ 


Note.  We  will  not  use  any  of  the  clipart  in  the  actual  items, 
but  it  is  a way  to  communicate  approximately  what  the 
graphic  should  look  like. 
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Use  Basic  Codes  in  ItemSet  Spreadsheets 

(see  ExampleSheet  K-5CCSS.docx  for  more) 

• Image:  [img]item_7NS3008.png[/img] 

• Division  symbol:  Bt4  = 3[divide]4  = 3[div]4 

• Long  division:  3[longdiv]42[/longdiv] 

• Square  roots:  V25  = [squareroot]25[/ 
squareroot] 

• Pi:  Jt  = [pi] 

• Vertically  stacked  add/sub/multiply: 

[plus]30:40:12[/plus]  30 

40 
+ 12 


Excel  Sheet  (see  Example  Problems) 
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The  Basic  Process 

Item  Writers: 

• You  will  write  and  turn  items  in  batches, 
approximately  ~20-40  items  at  a time,  and  email 
them  to  me  for  a quick  check  for  completeness 
and  quality,  with  all  250  items,  two  completed 
ItemSet  spreadsheets  due  by  Friday,  January  11th, 
2013. 

• I will  email  OKd  items  to  Item  Reviewers. 

• Item  Reviewers  will  individually  be  reviewing, 
editing  aj[  items  for  ways  to  improve  them,  and 
returning  them  to  me,  but  they  should  be  a 
strong  as  you  can  get  them  before  emailing  them 
to  me. 


The  Basic  Process  (cont.) 

Item  Reviewers: 

• After  you  have  reviewed/edited  all  items  in  an 
item  set  and  deemed  them  to  be  (a)  aligned  to 
the  standard,  (b)  mathematically  accurate,  (c) 
grade-level  appropriate,  (d)  free  of  bias,  and  (e) 
"good"  overall  items,  you  turn  in  the  ItemSet 
spreadsheet  to  me  at  BRT. 

• Email  items  back  to  me  in  batches,  a full  ItemSet 
(i.e.,  125  group  of  grade-level  items  from  a single 
Item  Writer)  at  a time  ->  you  will  turn  in  a total 
of  four  of  these  for  your  grade,  with  all  ItemSets 
due  by  Friday,  January  25th,  2013 
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Deadlines  and  Compensation 

• Compensation  will  be  released  upon  completion 
of  your  work,  pending  approval  by  BRT  and  the 
University  of  Oregon  (me) 

• $800  for  Item  Writers  completing  two  ItemSets 
of  125  items  each,  250  total  ->  January,  11th, 
2013 

• $1500  for  Item  Reviewers  for  reviewing/editing 
500  grade-level  math  items  ->  January,  25th, 
2013 


Study-related  or 
Procedural 
QUESTIONS? 
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Some  Basic  Item  Writing 
Guidelines 
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Why  multiple 

choice  items? 

“Selected-response  items  are  the  most  appropriate  item 

format  for  measuring  cognitive  achievement  or  ability, 

especially  higher  order  cognitive  achievement  or  cognitive 

abilities,  such  as  problem  solving,  synthesis,  and 

evaluation.”  (Downing,  2006,  p.  288) 

• Validity 

• Efficiency 

— Less  chance  of 

— Easy  to  administer 

construct  irrelevant 

— Easy  to  produce 

variance  in  scores 

— Easy  to  score 

— Allow  a given  skill 

objectively  (as 

to  be  assessed 

opposed  to 
constructed 

multiple  times 

response  item 

(multiple  items) 

types) 

How  do  you  write  a good  item? 

Art  or  SCIENCE?  (maybe  a little  of  both) 


Answer  Options: 

• Use  only  3 options:  1 
correct  response  and  2 
distracters 

• Choose  logical  distracters 

• Avoid  excess  text  or 
irrelevant  features 


Assess  Only  Target  Knowledge: 

• Targeting  Math 

• Reduce  language  as  much  as 
possible 

• If  the  item  is  supposed  to 
assess  fractions,  make  sure  it 
doesn't  assess  other  factors, 
such  as  conversions  or 
estimations. 

Be  Sensitive  of  Bias  Issues: 

• Keep  in  mind  the  population  of 
students  who  will  be  taking  the 
items 

• Consider  ELL,  SWD,  diverse 
cultures,  etc. 
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Universal  Design 

How  should  we  design  a building  so  the  widest  range 
of  populations  possible  can  access  it? 


Universal  Design  for  Assessment 


• Considers  all  characteristics  of  test-takers. 

• Precisely  defined  constructs. 

• Accessible,  non-biased  items. 

•"  Items  amendable  foaccommodanonsl  j 

• Simple,  clear,  and  intuitive  instructions  and  j 

procedures.  I 


Maximum  readability  and  comprehensibility. 

Maximum  legibility  of  text,  tables,  figures,  and 
illustrations 


Thompson,  Johnstone,  and  Thurlow  (2002) 
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TABLE  1 

A Revised  Taxonomy  of  Multiple-Choice  (MC)  hem- Writing  Guidelines 


Content  concerns 

1.  Every  item  should  reflect  specific  content  and  a single  specific  menial  behavior,  as  called  for  in 
test  specifications  (two-way  grid,  test  blueprint). 

2.  Base  each  item  on  important  content  to  learn:  avoid  trivial  conlenL 

3.  Use  novel  material  to  test  higher  level  learning.  Paraphrase  textbook  language  or  language  used 
during  instruction  when  used  in  a test  item  to  avoid  testing  for  simply  recall. 

4.  Keep  the  content  of  each  item  independent  from  content  of  other  items  on  the  tesL 

5.  Avoid  over  specific  and  over  general  content  when  writing  MC  items. 

6.  Avoid  opinion-based  items. 

7.  Avoid  trick  items. 

8.  Keep  vocabulary  simple  for  the  group  of  students  being  tested. 

Formatting  concerns 

9.  Use  the  question,  completion,  and  best  answer  versions  of  the  conventional  MC,  the  alternate 
choice,  true-false  (TF).  multiple  true-false  (MTF).  matching,  and  the  context-dependent  item 
and  item  set  formats,  but  AVOID  the  complex  MC  (Type  K)  format. 

10.  Format  the  item  vertically  instead  of  horizontally. 

Style  concerns 

1 1.  Edit  and  proof  items. 

12.  Use  correct  grammar,  punctuation,  capitalization,  and  spelling. 

13.  Minimize  the  amount  of  reading  in  each  item. 

Writing  the  stem 

14.  Ensure  that  the  directions  in  the  stem  are  very  clear. 

15.  Include  the  central  idea  in  the  stem  instead  of  the  choices. 

16.  Avoid  window  dressing  (excessive  verbiage). 

17.  Word  the  stem  positively,  avoid  negatives  such  as  NOT  or  EXCEPT.  If  negative  words  are  used, 
use  the  word  cautiously  and  always  ensure  that  the  word  appears  capitalized  and  boldface. 


TABLE  1 

A Revised  Taxonomy  of  Multiple-Choice  (MC)  Hem-Writing  Guidelines 


Writing  the  choices 

18.  Develop  as  many  effective  choices  as  you  can.  but  research  suggests  three  is  adequate. 

19.  Make  sure  that  only  one  of  these  choices  is  the  right  answer. 

20.  Vary  the  location  of  the  right  answer  according  to  the  number  of  choices. 

21 . Place  choices  in  logical  or  numerical  order. 

22.  Keep  choices  independent:  choices  should  not  be  overlapping. 

23.  Keep  choices  homogeneous  in  content  and  grammatical  structure. 

24.  Keep  the  length  of  choices  about  equal. 

25.  None-of-lhe-uboxe  should  be  used  carefully. 

26.  Avoid  All-of-the -above. 

27.  Phrase  choices  positively:  avoid  negatives  such  as  NOT. 

28.  Avoid  giving  clues  to  the  right  answer,  such  as 

a.  Specific  determiners  including  always,  never,  completely,  and  absolutely. 

b.  Clang  associations,  choices  identical  to  or  resembling  words  in  the  stem. 

c.  Grammatical  inconsistencies  that  cue  the  test-taker  to  the  correct  choice. 

d.  Conspicuous  correct  choice. 

e.  Pairs  or  triplets  of  options  that  clue  the  test-taker  to  the  correct  choice. 

f.  Blatantly  absurd,  ridiculous  options. 

29.  Make  all  distractors  plausible. 

30.  Use  typical  errors  of  students  to  write  your  distractors. 

31.  Use  humor  if  it  is  compatible  with  the  teacher  and  the  learning  environment. 


Haladyna,  2002,  p.  312 
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Content  Concerns 

“Every  item  should  reflect  specific  content  and  a single 
specific  cognitive  process”  (Haladyna,  2004,  p.  98). 

Guidelines 

• Write/review  items  that  align  with  only  one  standard 
(or  one  part  of  one  standard),  and  that  the  item 
targets  that  standard  clearly  and  directly. 

— Target  only  one  skill  in  each  item.  If  standard  asks  for 
multiple  skills,  use  multiple  items. 

• Try  not  to  be  over-specific  or  over-general. 

• Try  not  to  "trick  the  students" 

• Each  item  should  be  independent  of  all  others. 

• Avoid  focusing  items  on  trivial  parts  of  standards. 

• Present  items  in  novel  formats 

Note.  The  following  slides  are  largely  based  on  Haladyna,  2004. 


Targeting  Only  One  Skill 

Standard  6.SP:  Recognize  that  a measure  of  center  for  a numerical  data  set  summarizes  all  of 
its  values  with  a single  number,  while  a measure  of  variation  describes  how  its  values  vary  with 

a single  number. 

Example  item  1 

Example  item  2 

Which  number 

Which  number 

describes  the  center  of 

describes  the  center  of 

the  dataset? 

the  dataset? 

Dataset:  5,  7,  3,  3 

Dataset:  5,  7,  3,  3 

A)  Average  -4.50 

A)  4.50 

B)  Standard  deviation  - 1.91 

B)  1.91 

C)  Range -4.00 

C)  4.00 
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Targeting  Only  One  Skill 

Example  item  1 

Example  item  2 

• The  first  item  provides  the 

• Second  item  requires 

student  with  the  name  of 

student  to  both  know  the 

the  statistic  AND  the 

best  statistic  (average)  AND 

number. 

to  recognize  which  number 

• The  target  skill  of  the  item 
(measure  of  central 

represents  that  statistic. 

tendency)  is  not  confused 

• Item  has  less  text,  but  in 

with  other  math  skills. 

this  case,  the  text  may  help 

HOWEVER - 
• Item  still  requires 

vocabulary  and  additional 
reading  skills  over  a simpler 
version 

target  the  skill  of  interest. 

Targeting  Only  One  Skill 

• Both  items  target  only  one  part  of  the 
standard  (central  tendency),  yet  item  2 still 
targets  multiple  math  skills. 

— Note:  if  we  were  interested  in  knowing  students' 
skills  with  calculating  the  average,  we  could  easily 
address  it  with  a different  item. 

Example 

The  average  of:  4,  3,  9,  4 = ? 

- A)  5 

- B)  20 
-C)4 
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Over-specific/Over-general 

Over-specific  item 

Over-general  item 

Who  wrote  the  Icon  of  Seville? 

Which  is  the  most  serious 

A)  Lorca 

problem  in  the  world? 

B)  Ibanez 

A)  hunger 

C)  Rodriguez 

B)  lack  of  education 

C)  disease 

Over-specific  items  often  assess 

Over-general  items  are  often 

trivial  content. 

opinion-based. 

Balancing  the  generality  of  an  item  is 

part  of  the  "art"  of  writing  good  items. 

Note.  Examples  from  Haladyna,  2004,  p.  102. 

Trick  Questions 

• Is  there  a fourth  of  July  in  England? 

Yes,  there  is  a fourth  of  July  everywhere. 

• Some  months  have  31  days.  How  many  have 
28? 

All  of  them 

• How  many  animals  of  each  gender  did  Moses 
bring  on  his  ship? 

None.  Moses  didn't  have  a ship,  Noah  did. 

• A butcher  in  the  meat  market  is  six  feet  tall. 
What  does  he  weigh? 

Meat 

Note.  Examples  from  Haladyna,  2004,  p.  104. 
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Trick  Questions 

“There  are  enough  problems  in  testing 
without  contributing  more  by  using  trick 
items.”  (Haladyna,  2004,  p.  104) 


Formatting  Concerns 

• Make  sure  stem  is  a complete  sentence/ 
directive. 

• Make  sure  item  is  multiple  choice,  and 
contains  three  options  (correct  response  and 
two  plausible  distracters). 

• Correct  response  is  always  answer  Option  A 

— Because  items  will  be  computer-administered,  we 
will  randomly  rotate  all  options.  For  development 
purposes,  it's  easiest  to  always  keep  the  correct 
response  in  a consistent  location. 

All  other  formatting  concerns  are  BRT  responsibility 
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Style  Concerns 

• Please  proof  read  all  items  you  wrote  before  you 
turn  them  over  to  me  (both  Writers  and 
Reviewers) 

• Primary  things  to  look  for: 

— Grammar 

- Can  the  reading  load  be  reduced  without  losing 
clarity? 

— Is  there  more  than  one  construct/skill? 

— Bias  and  sensitivity  (i.e.,  variety  of  diverse  names  - 
Google  them!) 


Stem  Construction 

• Try  to  be  as  clear  and  concise  as  possible 

• Make  sure  the  stem  is  complete  and  contains 
all  the  information  needed  to  solve  the 
problem. 
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Developing  Options  (correct  option 
and  two  plausible  distractors) 

• Probably  the  most  difficult  part  of  an  item  to 
develop. 

• Answer  options  must  be  reasonable  and  have 
only  one  justifiably  correct  answer  (e.g.,  if  you 
can  make  a reasonable  argument  that  one  of 
the  distracters  is  also  correct,  it  is  not  a good 
distracter). 

• You're  an  expert!!!  Think  about  the  common 
math  mistakes  your  students  make! 


Developing  Options  (cont.) 

In  a perfectly  functioning  item... 

• Stem  contains  all  the  information  needed  to 
solve  the  question 

— Answer  option  A is  the  correct  response,  and  will  be 
chosen  by  students  who  understand  the  content 
targeted  by  the  item. 

— Answer  option  B is  a close  distracter,  and  will  be 
chosen  by  students  who  have  partial,  but  incomplete 
knowledge  of  the  content  targeted  by  the  item. 

— Answer  option  C is  a far  distracter  (but  not  TOO  far), 
and  will  be  chosen  by  students  who  have  little  to  no 
knowledge  of  the  content  targeted  by  the  item. 


easyCBM  CCSS  Third  Grade  Math  Measure  Development 


62 

Appendix  A:  Training 


Developing  Options  (cont.) 

• Keep  format  of  each  option  the  same  (length, 
grammar,  etc.) 

• Do  not  use  "all  of  the  above"  or  "none  of  the 
above" 

• Keep  distracters  plausible,  but  avoid  hinting  at 
the  correct  response. 

• Try  to  use  distracters  that  represent  typical 
student  errors 


Developing  Options  (cont.) 

• Although  guidelines  can  help,  coming  up  with 
reasonable  options  is  difficult.  Getting  the 
options  to  all  function  the  way  they  are 
intended  to  is  even  more  difficult. 

— Why  some  refer  to  item  writing  as  an  art  (as 
opposed  to  a science)  it's  a little  of  both 
though! 
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Hypothetical  Example 

• Imagine  a kindergarten  or  first  grade  standard 
that  requires  students  have  knowledge  of 
basic  geometric  shapes  - faces,  sides,  angles, 
etc. 

— i.e.,  squares,  circles,  triangles,  rectangles,  etc. 


Item  Non-Example 

Greg  and  Sally  were  both  in  the  first  grade.  Greg 
liked  the  color  blue  and  always  wore  a blue  shirt. 
Sally  liked  the  color  green  and  always  wore  a 
green  shirt.  Which  shirt  has  more  triangles  on 
it? 


a)  blue  c)  Sally  e)  triangles 

b)  green  d)  Greg 
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Why  this  is  a poor  item 

• Way  too  much  text 

• Lots  of  irrelevant  information 

• Low-cognitive-level  question  (basically  counting  - 
though  some  standards  this  skill  is  targeted) 

• What  if  the  student  is  color  blind? 

• Too  many  options 

- Not  logical  distracters 

— There  is  arguably  more  than  one  correct  response 
option  (either  blue  or  Greg) 

• Doesn't  really  address  the  standard 


Item  non-example  2 

Triangles: 

a)  have  three  sides 

b)  have  two  long  sides  and  two  short  sides 

c)  have  rounded  edges 

d)  all  of  the  above 

e)  none  of  the  above 
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Why  this  is  a poor  item 

• Stem  does  not  present  the  information 
needed  solve  the  problem. 

• Uses  the  "all  of  the  above"  and  "none  of  the 
above"  options 

— Although  there  is  some  empirical  evidence 
supporting  that  the  "all  of  the  above"  option 
increases  the  difficulty  (Huang,  Trevisan,  & 
Storfer,  2007),  the  general  consensus  is  that  it 
creates  a "cueing"  effect  for  students.  Also, 
students  may  choose  these  options  with  mis-  or 
partial  knowledge. 


easyCBM  CCSS  Third  Grade  Math  Measure  Development 


66 

Appendix  A:  Training 


Why  is  this  a better  item? 

• Clearly  addresses  the  standard 

• Low  level  of  text 

• No  irrelevant  information 


Language  Issues 


For  math  items,  excess  text  threatens  validity 

- Particularly  worrisome  for  English  language 
learners  (ELL) 


What  to  do? 


— Use  familiar,  grade- 
level  appropriate 
words 

— Omit  all  unnecessary 
words 

— Use  no  text  if  possible, 
or  keep  sentences  as 
brief  as  possible 


— Avoid  conditional 
and  relative  clauses 

— Avoid  negation 

— Use  concrete 
versus  abstract 
representation 


easyCBM  CCSS  Third  Grade  Math  Measure  Development 


67 

Appendix  A:  Training 


Now....  Time  to  look  at  some  real  items! 

Existing  easyCBM  items 


Existing  easyCBM  items 

• Note.  There's  only  a limited  amount  we  can 
learn  from  these  items 

— Aligned  to  different  standards 
— Developed  for  a different  population 

However 

• Formatting  will  be  similar 

• Universal  design  features  evident 

• Good  item  writing  principles  applied 

• Perhaps  most  important  - We  know  they  work! 
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Existing  easyCBM  item 

Standard:  Solve  problems  about  similar  objects  (including  figures)  by  using  scale 
factors  that  relate  corresponding  lengths  of  the  objects  or  by  using  the  fact  that 
relationships  of  lengths  within  an  object  are  preserved  in  similar  objects. 

• Universal  Design  features? 

• Targets  a single  skill? 

• Over-specific/over-general? 

• Clear  and  concise? 

• Alignment? 

• Other  concerns? 

a.  \ in.  Remember:  These  items  were  designed  for  very  low 

b.  4 in.  performing  students.  The  new  items  should  target 

c.  5 in.  students  at  or  slightly  below  grade-level  expectations. 


Existing  easyCBM  item 

Standard:  Use  descriptive  statistics,  including  mean,  median,  and  range,  to  summarize 
and  compare  data  sets. 


B.  $9 

C.  $12 


• Universal  Design  features? 

• Targets  a single  skill? 

• Over-specific/over-general? 

• Clear  and  concise? 

• Alignment? 

• Other  concerns? 
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One  more... 

Standard:  Explain  why  the  sum  of  the  measures  of  the  angles  in  a triangle  is  180 
degrees,  and  they  apply  this  fact  about  triangles  to  find  unknown  measures  of  angles. 

• Universal  Design  features? 

• Targets  a single  skill? 

• Over-specific/over-general? 

• Clear  and  concise? 

• Alignment? 

• Other  concerns? 

A.  38° 

B.  71° 

C.  16° 


How  do  you  become  a good  item  writer? 

“Effective  item  writers  are  trained,  not 
born...  Although  item  writers  must  be 
expert  in  their  own  disciplines,  there  is  no 
reason  to  believe  that  their  subject  matter 
expertise  generalizes  to  effective  item 
writing  expertise.” 

(Downing,  2006,  p.  11) 
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Appendix  A:  Training 


Bottom  line 

“Practice  does  not  make  perfect.  Only 
perfect  practice  makes  perfect.” 
-Vince  Lombardi 

• Practice,  practice,  practice. 

- Practice  writing  different  types  of  items 

• Geometry,  number  & operation,  etc. 

- Look  back  at  other  test  items 

• Find  examples  of  good  and  bad  items 


Resources 

• Multiple  choice  item  writing  Do's  and  Don'ts 

— http://www.eric.ed.gov/PDFS/ED398238.pdf 

• Recommendations  portion  of  the  following 
IDEA  paper 

- http://www.theideacenter.org/IDEAPaperl6 

Plenty  more  resources  online  can  be  found  with 
a quick  Google  search. 
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Appendix  B:  Item  Statistics  by  Test  Form 


Appendix  B:  Item  Statistics  by  Test  Form 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

1 

1 

3NF25 

-0.56 

110 

100 

0.35 

0.94 

-0.15 

0.98 

0.12 

0.31 

1.05 

1 

2 

3NF258 

0.82 

124 

86 

0.22 

1.01 

0.18 

0.98 

-0.06 

0.44 

0.98 

1 

3 

3NF316 

1.36 

110 

74 

0.23 

0.85 

-1.50 

0.76 

-1.30 

0.54 

1.31 

1 

4 

3MD411 

-0.83 

246 

225 

0.24 

0.87 

-0.73 

0.55 

-1.40 

0.38 

1.12 

1 

5 

3MD83 

0.60 

110 

83 

0.25 

0.78 

-1.86 

1.08 

0.38 

0.54 

1.28 

1 

6 

3MD310 

1.51 

111 

69 

0.22 

1.16 

1.87 

1.27 

1.76 

0.27 

0.53 

1 

7 

3G219 

-1.74 

106 

100 

0.44 

0.91 

-0.16 

0.85 

0.01 

0.27 

1.05 

1 

8 

31152 

-1.28 

54 

45 

0.40 

1.04 

0.23 

0.98 

0.10 

0.31 

0.96 

1 

9 

31157 

-0.70 

43 

33 

0.39 

1.00 

0.07 

0.87 

-0.20 

0.38 

1.03 

1 

10 

31167 

-0.35 

55 

38 

0.33 

0.89 

-0.76 

0.81 

-0.58 

0.51 

1.22 

1 

11 

3G123 

0.36 

120 

94 

0.24 

1.02 

0.23 

1.08 

0.43 

0.30 

0.95 

1 

12 

3G124 

0.85 

118 

83 

0.23 

1.05 

0.49 

0.94 

-0.31 

0.41 

0.96 

1 

13 

3G141 

1.38 

114 

71 

0.22 

1.20 

2.14 

1.22 

1.46 

0.30 

0.54 

1 

14 

30667 

-1.54 

54 

46 

0.42 

0.89 

-0.34 

0.76 

-0.39 

0.43 

1.10 

1 

15 

30240 

-1.19 

59 

48 

0.36 

1.04 

0.25 

0.78 

-0.40 

0.35 

1.01 

1 

16 

30842 

-0.81 

48 

39 

0.40 

0.91 

-0.30 

0.77 

-0.42 

0.39 

1.12 

1 

17 

30972 

-0.22 

56 

36 

0.30 

1.07 

0.68 

1.00 

0.09 

0.31 

0.83 

1 

18 

30097 

0.17 

57 

31 

0.31 

0.79 

-1.88 

0.69 

-1.45 

0.58 

1.60 

1 

19 

30821 

1.22 

277 

157 

0.14 

1.02 

0.33 

0.98 

-0.23 

0.48 

0.98 

1 

20 

30534 

3.10 

56 

7 

0.46 

0.88 

-0.30 

0.72 

-0.30 

0.50 

1.10 

1 

21 

30188 

-1.21 

58 

49 

0.38 

0.97 

-0.06 

0.74 

-0.44 

0.34 

1.06 

1 

22 

30312 

-0.89 

57 

43 

0.36 

0.94 

-0.25 

0.80 

-0.54 

0.51 

1.10 

1 

23 

30047 

-0.55 

304 

264 

0.18 

0.86 

-1.28 

0.60 

-1.73 

0.45 

1.16 

1 

24 

30341 

0.45 

60 

33 

0.29 

0.89 

-1.03 

0.85 

-0.83 

0.53 

1.32 

1 

25 

30471 

0.72 

55 

26 

0.29 

0.85 

-1.49 

0.83 

-1.29 

0.54 

1.52 

1 

26 

30474 

1.35 

56 

20 

0.31 

1.02 

0.17 

0.93 

-0.04 

0.39 

0.99 

1 

27 

30777 

2.38 

54 

12 

0.37 

1.13 

0.67 

1.24 

0.66 

0.35 

0.82 

1 

28 

3NBT128 

0.10 

120 

99 

0.26 

0.95 

-0.28 

1.44 

1.38 

0.33 

0.99 

1 

29 

3NBT23 

0.79 

106 

69 

0.23 

0.94 

-0.63 

1.14 

0.80 

0.46 

1.07 

1 

30 

3NBT125 

1.06 

235 

160 

0.15 

0.93 

-1.13 

0.85 

-1.19 

0.46 

1.18 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

2 

1 

3NF228 

-0.99 

120 

111 

0.36 

0.90 

-0.31 

0.65 

-0.58 

0.33 

1.08 

2 

2 

3NF254 

0.78 

108 

69 

0.22 

1.19 

1.98 

1.20 

1.24 

0.28 

0.56 

2 

3 

3NF243 

1.53 

125 

71 

0.21 

1.11 

1.29 

1.10 

0.74 

0.40 

0.76 

2 

4 

3MD66 

-0.68 

123 

113 

0.35 

0.98 

0.01 

0.96 

0.08 

0.26 

1.00 

2 

5 

3MD312 

0.60 

116 

88 

0.24 

0.77 

-2.02 

0.55 

-1.98 

0.58 

1.37 

2 

6 

3MD512 

1.55 

123 

77 

0.21 

1.18 

2.04 

1.17 

1.16 

0.29 

0.60 

2 

7 

30744 

-1.69 

47 

42 

0.49 

1.05 

0.26 

1.00 

0.17 

0.19 

0.97 

2 

8 

3G115 

-1.26 

118 

110 

0.38 

1.01 

0.13 

1.02 

0.22 

0.18 

0.98 

2 

9 

30290 

-0.72 

53 

43 

0.37 

0.97 

-0.09 

0.89 

-0.20 

0.35 

1.05 

2 

10 

30133 

-0.34 

66 

47 

0.30 

0.92 

-0.53 

0.90 

-0.40 

0.45 

1.14 

2 

11 

30855 

0.43 

50 

28 

0.32 

0.84 

-1.40 

0.76 

-1.11 

0.55 

1.49 

2 

12 

3G154 

0.88 

107 

77 

0.25 

1.10 

0.84 

1.14 

0.68 

0.44 

0.86 

2 

13 

30853 

1.39 

44 

14 

0.34 

1.13 

0.93 

1.14 

0.73 

0.19 

0.70 

2 

14 

30370 

-1.53 

56 

48 

0.43 

0.81 

-0.61 

0.54 

-0.75 

0.55 

1.18 

2 

15 

30526 

-1.17 

52 

45 

0.43 

1.01 

0.12 

0.74 

-0.38 

0.33 

1.03 

2 

16 

30059 

-0.83 

68 

57 

0.34 

1.04 

0.24 

0.90 

-0.16 

0.26 

0.99 

2 

17 

30844 

-0.24 

60 

42 

0.31 

1.09 

0.65 

1.11 

0.53 

0.32 

0.84 

2 

18 

30825 

0.17 

56 

37 

0.30 

1.06 

0.56 

1.03 

0.21 

0.27 

0.84 

2 

19 

30243 

1.35 

51 

18 

0.34 

1.10 

0.64 

1.07 

0.37 

0.42 

0.85 

2 

20 

30695 

2.96 

56 

7 

0.42 

1.20 

0.73 

1.47 

1.06 

0.03 

0.81 

2 

21 

30023 

-1.19 

56 

47 

0.38 

1.11 

0.56 

1.15 

0.46 

0.19 

0.87 

2 

22 

30936 

-0.90 

53 

41 

0.36 

0.70 

-1.63 

0.54 

-1.56 

0.66 

1.39 

2 

23 

30160 

-0.54 

58 

43 

0.33 

0.94 

-0.33 

0.97 

-0.04 

0.42 

1.08 

2 

24 

30A113 

0.44 

126 

95 

0.23 

0.84 

-1.46 

0.64 

-1.70 

0.55 

1.28 

2 

25 

30A816 

0.72 

117 

82 

0.22 

0.94 

-0.60 

0.87 

-0.64 

0.44 

1.13 

2 

26 

30A613 

1.35 

116 

71 

0.21 

0.96 

-0.42 

0.91 

-0.63 

0.43 

1.12 

2 

27 

30173 

2.18 

64 

16 

0.32 

1.26 

1.54 

1.42 

1.37 

0.16 

0.59 

2 

28 

3NBT130 

0.11 

125 

106 

0.27 

0.90 

-0.56 

0.63 

-1.19 

0.44 

1.13 

2 

29 

3NBT214 

0.78 

111 

85 

0.25 

1.00 

0.06 

0.97 

-0.03 

0.39 

1.01 

2 

30 

3NBT313 

1.05 

123 

88 

0.22 

0.95 

-0.46 

1.13 

0.72 

0.42 

1.03 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

3 

1 

3NF237 

-0.67 

235 

213 

0.23 

0.98 

-0.07 

0.75 

-0.69 

0.28 

1.04 

3 

2 

3NF245 

0.75 

123 

94 

0.23 

1.04 

0.33 

1.06 

0.33 

0.35 

0.94 

3 

3 

3NF31 

1.66 

107 

50 

0.22 

0.80 

-2.46 

0.76 

-2.13 

0.61 

1.54 

3 

4 

3MD73 

-0.38 

114 

100 

0.30 

1.08 

0.48 

1.19 

0.58 

0.23 

0.92 

3 

5 

3MD47 

0.61 

110 

74 

0.23 

0.81 

-2.09 

0.78 

-1.33 

0.55 

1.39 

3 

6 

3MD48 

1.58 

107 

65 

0.24 

1.11 

1.07 

1.18 

1.10 

0.47 

0.77 

3 

7 

31027 

-1.74 

57 

51 

0.46 

0.85 

-0.42 

0.71 

-0.30 

0.41 

1.13 

3 

8 

3G111 

-1.29 

113 

106 

0.41 

1.07 

0.32 

1.27 

0.58 

0.19 

0.93 

3 

9 

30721 

-0.76 

49 

37 

0.36 

1.08 

0.45 

1.07 

0.33 

0.34 

0.89 

3 

10 

31046 

-0.34 

58 

42 

0.32 

0.95 

-0.29 

0.87 

-0.48 

0.43 

1.11 

3 

11 

30447 

0.34 

57 

34 

0.30 

0.82 

-1.62 

0.70 

-1.58 

0.58 

1.53 

3 

12 

31189 

0.91 

60 

31 

0.29 

1.01 

0.15 

1.07 

0.52 

0.40 

0.92 

3 

13 

3G143 

1.40 

125 

74 

0.21 

0.89 

-1.20 

0.81 

-1.39 

0.55 

1.26 

3 

14 

30511 

-1.50 

47 

41 

0.49 

0.87 

-0.29 

0.72 

-0.29 

0.51 

1.11 

3 

15 

30205 

-1.14 

64 

52 

0.35 

0.95 

-0.18 

0.77 

-0.55 

0.43 

1.08 

3 

16 

30058 

-0.75 

57 

43 

0.33 

1.15 

0.93 

1.26 

0.95 

0.18 

0.75 

3 

17 

30978 

-0.26 

57 

39 

0.32 

0.94 

-0.41 

0.80 

-0.69 

0.45 

1.18 

3 

18 

30249 

0.20 

48 

29 

0.32 

0.79 

-1.79 

0.70 

-1.56 

0.60 

1.61 

3 

19 

30848 

1.41 

57 

21 

0.30 

1.00 

0.00 

0.96 

-0.23 

0.41 

1.04 

3 

20 

30696 

2.73 

54 

10 

0.39 

1.02 

0.17 

1.16 

0.55 

0.38 

0.95 

3 

21 

30305 

-1.17 

58 

48 

0.37 

0.99 

0.02 

0.74 

-0.58 

0.40 

1.06 

3 

22 

30336 

-0.90 

57 

45 

0.37 

0.82 

-0.87 

0.60 

-1.02 

0.53 

1.24 

3 

23 

30633 

-0.53 

56 

41 

0.34 

0.93 

-0.36 

0.91 

-0.13 

0.47 

1.10 

3 

24 

30003 

0.46 

60 

35 

0.29 

1.02 

0.22 

0.98 

-0.07 

0.38 

0.97 

3 

25 

3OA410 

0.71 

125 

89 

0.22 

0.93 

-0.68 

0.79 

-1.06 

0.50 

1.16 

3 

26 

30321 

1.38 

60 

20 

0.30 

0.99 

-0.06 

1.04 

0.24 

0.41 

1.01 

3 

27 

30469 

2.12 

48 

13 

0.37 

0.81 

-1.05 

0.79 

-0.62 

0.58 

1.26 

3 

28 

3NBT33 

0.18 

106 

80 

0.25 

0.91 

-0.68 

0.74 

-1.02 

0.47 

1.16 

3 

29 

3NBT317 

0.73 

109 

83 

0.24 

0.96 

-0.26 

0.82 

-0.72 

0.40 

1.09 

3 

30 

3NBT232 

1.02 

121 

81 

0.21 

0.87 

-1.59 

0.74 

-1.52 

0.51 

1.34 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

4 

1 

3NF27 

-0.94 

107 

98 

0.38 

0.85 

-0.55 

0.54 

-0.72 

0.40 

1.13 

4 

2 

3NF256 

0.67 

114 

85 

0.24 

0.95 

-0.39 

0.83 

-0.74 

0.44 

1.10 

4 

3 

3NF277 

1.61 

106 

74 

0.24 

1.08 

0.70 

1.24 

1.21 

0.37 

0.82 

4 

4 

3MD110 

-0.29 

110 

95 

0.31 

0.90 

-0.49 

0.67 

-0.74 

0.43 

1.11 

4 

5 

3MD31 

0.62 

109 

91 

0.28 

0.93 

-0.37 

0.72 

-0.79 

0.43 

1.10 

4 

6 

3MD210 

1.65 

119 

65 

0.20 

0.92 

-1.01 

0.86 

-1.22 

0.48 

1.26 

4 

7 

30556 

-1.68 

45 

39 

0.50 

1.06 

0.29 

0.84 

0.01 

0.43 

0.97 

4 

8 

31006 

-1.24 

38 

32 

0.51 

0.87 

-0.32 

0.63 

-0.48 

0.54 

1.14 

4 

9 

3G27 

-0.78 

108 

97 

0.34 

1.00 

0.10 

1.17 

0.51 

0.27 

0.98 

4 

10 

30142 

-0.33 

66 

47 

0.30 

0.89 

-0.72 

0.98 

0.00 

0.50 

1.13 

4 

11 

30860 

0.36 

60 

35 

0.28 

1.33 

2.83 

1.40 

2.47 

0.04 

-0.04 

4 

12 

3G132 

0.89 

106 

67 

0.23 

1.09 

1.02 

1.00 

0.03 

0.39 

0.84 

4 

13 

3G149 

1.40 

110 

71 

0.22 

1.22 

2.39 

1.24 

1.45 

0.23 

0.47 

4 

14 

30517 

-1.50 

46 

39 

0.46 

0.94 

-0.10 

0.72 

-0.36 

0.47 

1.08 

4 

15 

30090 

-1.12 

57 

46 

0.37 

0.72 

-1.30 

0.57 

-1.30 

0.59 

1.30 

4 

16 

30207 

-0.83 

53 

43 

0.38 

0.99 

0.02 

0.78 

-0.44 

0.43 

1.06 

4 

17 

30660 

-0.30 

56 

39 

0.32 

0.90 

-0.66 

0.98 

-0.02 

0.45 

1.14 

4 

18 

30698 

0.19 

54 

31 

0.31 

1.15 

1.28 

1.13 

0.76 

0.31 

0.61 

4 

19 

30843 

1.20 

56 

26 

0.30 

0.91 

-0.73 

0.85 

-0.89 

0.52 

1.27 

4 

20 

30395 

2.74 

56 

8 

0.42 

0.95 

-0.08 

0.96 

0.12 

0.40 

1.03 

4 

21 

30631 

-1.21 

57 

47 

0.39 

1.09 

0.46 

0.94 

0.01 

0.40 

0.95 

4 

22 

30159 

-0.87 

58 

44 

0.32 

0.93 

-0.41 

0.79 

-0.85 

0.38 

1.16 

4 

23 

30A112 

-0.54 

120 

107 

0.31 

0.97 

-0.08 

0.83 

-0.28 

0.31 

1.03 

4 

24 

30199 

0.45 

55 

31 

0.29 

1.07 

0.67 

1.10 

0.86 

0.27 

0.73 

4 

25 

30035 

0.71 

48 

25 

0.32 

0.99 

-0.02 

0.97 

-0.13 

0.43 

1.03 

4 

26 

30465 

1.38 

57 

21 

0.30 

0.94 

-0.47 

0.89 

-0.58 

0.47 

1.17 

4 

27 

30775 

2.13 

56 

14 

0.34 

1.23 

1.30 

1.45 

1.51 

0.17 

0.63 

4 

28 

3NBT322 

0.20 

107 

79 

0.24 

0.84 

-1.41 

0.68 

-1.57 

0.51 

1.30 

4 

29 

3NBT230 

0.76 

106 

87 

0.28 

0.98 

-0.06 

0.87 

-0.33 

0.39 

1.03 

4 

30 

3NBT114 

1.13 

129 

83 

0.21 

1.03 

0.33 

0.98 

-0.06 

0.44 

0.96 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

5 

1 

3NF22 

-0.91 

238 

219 

0.25 

0.84 

-0.84 

0.50 

-1.56 

0.38 

1.13 

5 

2 

3NF235 

0.69 

121 

88 

0.22 

1.16 

1.60 

1.49 

1.97 

0.22 

0.60 

5 

3 

3NF267 

1.31 

116 

72 

0.21 

0.89 

-1.39 

0.81 

-1.46 

0.50 

1.33 

5 

4 

3MD54 

-0.15 

106 

85 

0.26 

0.87 

-0.88 

1.00 

0.11 

0.44 

1.12 

5 

5 

3MD111 

0.66 

118 

88 

0.23 

0.87 

-1.12 

0.75 

-1.19 

0.49 

1.22 

5 

6 

3MD46 

1.70 

107 

56 

0.21 

1.10 

1.18 

1.10 

0.84 

0.35 

0.72 

5 

7 

31002 

-1.74 

55 

48 

0.44 

0.94 

-0.11 

0.59 

-0.75 

0.45 

1.10 

5 

8 

3G213 

-1.29 

121 

114 

0.40 

0.88 

-0.29 

0.93 

0.07 

0.29 

1.06 

5 

9 

30890 

-0.78 

39 

31 

0.42 

0.90 

-0.37 

1.15 

0.53 

0.38 

1.06 

5 

10 

30444 

-0.32 

57 

42 

0.33 

0.72 

-1.97 

0.59 

-1.55 

0.62 

1.48 

5 

11 

30576 

0.38 

59 

35 

0.30 

0.92 

-0.62 

0.85 

-0.71 

0.51 

1.21 

5 

12 

31194 

0.96 

56 

26 

0.30 

0.96 

-0.26 

1.10 

0.54 

0.47 

1.03 

5 

13 

3G134 

1.42 

111 

71 

0.22 

1.20 

2.24 

1.20 

1.28 

0.25 

0.51 

5 

14 

30362 

-1.47 

67 

59 

0.40 

0.90 

-0.29 

0.72 

-0.44 

0.41 

1.09 

5 

15 

30519 

-1.07 

43 

36 

0.43 

1.03 

0.19 

0.82 

-0.33 

0.30 

1.02 

5 

16 

30837 

-0.78 

61 

47 

0.33 

0.94 

-0.29 

1.05 

0.25 

0.39 

1.03 

5 

17 

30250 

-0.31 

49 

34 

0.34 

0.83 

-1.20 

0.87 

-0.43 

0.52 

1.31 

5 

18 

30683 

0.27 

297 

232 

0.16 

0.83 

-2.14 

0.60 

-2.49 

0.56 

1.25 

5 

19 

30846 

1.41 

59 

21 

0.31 

0.81 

-1.44 

0.77 

-1.19 

0.59 

1.38 

5 

20 

30221 

2.99 

48 

8 

0.43 

1.02 

0.18 

1.13 

0.41 

0.35 

0.94 

5 

21 

30196 

-1.22 

61 

50 

0.37 

0.97 

-0.08 

0.71 

-0.61 

0.46 

1.08 

5 

22 

30158 

-0.84 

61 

48 

0.33 

0.98 

-0.07 

1.19 

0.71 

0.35 

1.01 

5 

23 

31068 

-0.53 

69 

55 

0.32 

0.90 

-0.53 

1.03 

0.20 

0.39 

1.08 

5 

24 

30479 

0.45 

49 

27 

0.33 

0.82 

-1.31 

0.77 

-0.94 

0.60 

1.40 

5 

25 

31083 

0.71 

57 

31 

0.29 

1.13 

1.21 

1.34 

2.23 

0.23 

0.45 

5 

26 

30783 

1.36 

47 

16 

0.35 

1.07 

0.48 

1.31 

0.79 

0.37 

0.79 

5 

27 

30331 

2.21 

57 

13 

0.33 

1.09 

0.57 

1.34 

1.01 

0.16 

0.79 

5 

28 

3NBT328 

0.14 

122 

103 

0.27 

0.87 

-0.76 

0.62 

-1.22 

0.46 

1.16 

5 

29 

3NBT324 

0.72 

114 

84 

0.24 

0.83 

-1.54 

0.70 

-1.51 

0.53 

1.29 

5 

30 

3NBT127 

1.14 

116 

77 

0.22 

1.10 

1.05 

1.13 

0.81 

0.35 

0.79 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

6 

1 

3NF214 

-0.89 

111 

106 

0.33 

1.00 

0.07 

1.23 

0.60 

0.23 

0.99 

6 

2 

3NF278 

0.73 

109 

83 

0.24 

0.80 

-1.73 

0.65 

-1.65 

0.53 

1.33 

6 

3 

3NF242 

1.62 

120 

69 

0.21 

0.98 

-0.17 

0.94 

-0.42 

0.45 

1.06 

6 

4 

3MD64 

-0.07 

124 

102 

0.26 

1.05 

0.39 

0.97 

0.03 

0.35 

0.96 

6 

5 

3MD44 

0.73 

115 

85 

0.24 

0.97 

-0.21 

0.80 

-0.83 

0.46 

1.09 

6 

6 

3MD35 

1.70 

116 

65 

0.21 

0.80 

-2.47 

0.77 

-1.97 

0.60 

1.50 

6 

7 

30404 

-1.76 

44 

40 

0.56 

1.11 

0.39 

1.48 

0.84 

0.18 

0.91 

6 

8 

30854 

-1.23 

59 

49 

0.37 

0.97 

-0.08 

0.87 

-0.24 

0.35 

1.05 

6 

9 

30748 

-0.79 

51 

41 

0.37 

1.15 

0.77 

1.32 

1.03 

0.08 

0.79 

6 

10 

30440 

-0.33 

57 

39 

0.31 

0.84 

-1.28 

0.74 

-1.17 

0.53 

1.38 

6 

11 

31041 

0.34 

56 

35 

0.30 

0.82 

-1.65 

0.71 

-1.14 

0.55 

1.51 

6 

12 

30296 

0.89 

60 

28 

0.29 

1.04 

0.39 

1.09 

0.57 

0.38 

0.84 

6 

13 

3G138 

1.44 

116 

69 

0.21 

1.16 

1.90 

1.19 

1.45 

0.27 

0.54 

6 

14 

30547 

-1.42 

60 

53 

0.43 

0.83 

-0.51 

0.77 

-0.31 

0.44 

1.12 

6 

15 

30363 

-1.07 

66 

54 

0.36 

1.03 

0.22 

0.76 

-0.48 

0.43 

1.02 

6 

16 

30990 

-0.77 

57 

46 

0.36 

1.12 

0.63 

1.16 

0.51 

0.21 

0.86 

6 

17 

30809 

-0.31 

57 

38 

0.31 

0.96 

-0.23 

0.96 

-0.08 

0.44 

1.06 

6 

18 

30806 

0.26 

57 

36 

0.30 

0.91 

-0.76 

0.85 

-0.82 

0.49 

1.25 

6 

19 

30353 

1.18 

56 

23 

0.30 

1.14 

1.11 

1.21 

1.17 

0.32 

0.63 

6 

20 

30071 

2.97 

58 

8 

0.42 

0.96 

-0.05 

0.98 

0.12 

0.40 

1.02 

6 

21 

30754 

-1.15 

44 

38 

0.46 

0.81 

-0.56 

0.54 

-0.91 

0.51 

1.20 

6 

22 

30934 

-0.85 

56 

47 

0.38 

0.84 

-0.65 

0.68 

-0.64 

0.43 

1.18 

6 

23 

30A118 

-0.53 

106 

90 

0.29 

0.93 

-0.33 

0.98 

0.07 

0.36 

1.04 

6 

24 

30A813 

0.46 

116 

90 

0.24 

1.13 

1.05 

1.07 

0.38 

0.29 

0.83 

6 

25 

30195 

0.73 

52 

29 

0.31 

0.98 

-0.15 

0.92 

-0.34 

0.46 

1.09 

6 

26 

30041 

1.40 

50 

17 

0.34 

0.73 

-1.93 

0.64 

-1.69 

0.63 

1.55 

6 

27 

30A89 

2.32 

119 

50 

0.21 

1.23 

2.29 

1.30 

2.19 

0.32 

0.50 

6 

28 

3NBT210 

0.10 

120 

99 

0.26 

0.96 

-0.19 

1.22 

0.76 

0.34 

1.00 

6 

29 

3NBT115 

0.72 

117 

82 

0.22 

1.06 

0.63 

0.99 

0.01 

0.35 

0.91 

6 

30 

3NBT226 

1.15 

116 

72 

0.21 

0.97 

-0.35 

0.93 

-0.44 

0.45 

1.09 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

7 

1 

3NF211 

-0.72 

111 

106 

0.33 

0.84 

-0.62 

0.50 

-1.14 

0.40 

1.14 

7 

2 

3NF270 

0.61 

114 

86 

0.24 

1.08 

0.66 

1.19 

0.85 

0.32 

0.85 

7 

3 

3NF255 

1.30 

107 

70 

0.24 

0.98 

-0.17 

0.95 

-0.24 

0.53 

1.04 

7 

4 

3MD65 

-0.24 

114 

96 

0.27 

0.97 

-0.14 

0.77 

-0.60 

0.35 

1.06 

7 

5 

3MD69 

0.76 

106 

87 

0.28 

0.82 

-1.16 

0.59 

-1.40 

0.52 

1.23 

7 

6 

3MD32 

1.85 

108 

53 

0.21 

1.21 

2.48 

1.46 

3.48 

0.21 

0.27 

7 

7 

30552 

-1.77 

42 

38 

0.54 

0.97 

0.05 

0.70 

-0.26 

0.28 

1.05 

7 

8 

30555 

-1.21 

51 

42 

0.39 

1.01 

0.13 

0.87 

-0.14 

0.33 

1.01 

7 

9 

30719 

-0.79 

54 

42 

0.35 

0.95 

-0.21 

0.99 

0.07 

0.40 

1.04 

7 

10 

31183 

-0.31 

54 

37 

0.32 

0.85 

-1.09 

1.20 

0.82 

0.50 

1.22 

7 

11 

30876 

0.46 

58 

37 

0.30 

1.21 

1.53 

1.22 

1.04 

0.24 

0.54 

7 

12 

31191 

0.97 

54 

26 

0.30 

0.94 

-0.53 

0.87 

-0.66 

0.49 

1.21 

7 

13 

31024 

1.47 

47 

16 

0.33 

0.87 

-0.99 

0.88 

-0.65 

0.49 

1.31 

7 

14 

30232 

-1.41 

56 

46 

0.37 

0.99 

0.04 

0.84 

-0.26 

0.35 

1.03 

7 

15 

30089 

-1.15 

60 

50 

0.37 

0.89 

-0.42 

1.20 

0.61 

0.39 

1.05 

7 

16 

30364 

-0.87 

47 

37 

0.38 

1.02 

0.18 

0.90 

-0.14 

0.33 

0.99 

7 

17 

30670 

-0.26 

58 

37 

0.31 

1.07 

0.53 

1.01 

0.10 

0.41 

0.89 

7 

18 

30803 

0.29 

54 

36 

0.31 

0.83 

-1.37 

0.74 

-1.36 

0.55 

1.42 

7 

19 

30982 

1.19 

56 

28 

0.30 

1.06 

0.54 

1.03 

0.24 

0.44 

0.87 

7 

20 

30077 

2.97 

58 

10 

0.39 

1.06 

0.34 

1.11 

0.41 

0.37 

0.94 

7 

21 

30346 

-1.13 

57 

47 

0.40 

0.85 

-0.53 

0.73 

-0.54 

0.55 

1.14 

7 

22 

30166 

-0.84 

57 

46 

0.36 

0.79 

-1.06 

0.58 

-1.21 

0.52 

1.28 

7 

23 

30308 

-0.52 

53 

41 

0.35 

1.08 

0.48 

1.27 

0.87 

0.25 

0.84 

7 

24 

30481 

0.46 

56 

32 

0.30 

0.96 

-0.31 

0.86 

-0.50 

0.46 

1.17 

7 

25 

30946 

0.76 

62 

27 

0.28 

1.22 

1.86 

1.24 

1.46 

0.24 

0.41 

7 

26 

30768 

1.39 

62 

22 

0.30 

0.98 

-0.10 

1.29 

1.39 

0.41 

0.95 

7 

27 

30905 

2.21 

56 

13 

0.35 

0.98 

-0.04 

1.10 

0.41 

0.40 

0.98 

7 

28 

3NBT326 

0.20 

122 

96 

0.24 

0.84 

-1.27 

0.60 

-1.61 

0.53 

1.25 

7 

29 

3NBT315 

0.69 

106 

71 

0.23 

0.97 

-0.27 

0.88 

-0.59 

0.46 

1.08 

7 

30 

3NBT134 

1.17 

111 

76 

0.22 

1.01 

0.14 

0.97 

-0.14 

0.39 

0.99 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

8 

1 

3NF220 

-0.95 

129 

118 

0.33 

0.97 

-0.06 

0.81 

-0.24 

0.28 

1.03 

8 

2 

3NF241 

0.63 

116 

87 

0.24 

1.02 

0.20 

1.00 

0.08 

0.38 

0.98 

8 

3 

3NF252 

1.40 

116 

70 

0.21 

0.95 

-0.55 

0.91 

-0.64 

0.44 

1.14 

8 

4 

3MD212 

-0.28 

111 

90 

0.26 

1.02 

0.16 

0.85 

-0.45 

0.35 

1.01 

8 

5 

3MD23 

0.79 

116 

84 

0.23 

0.94 

-0.48 

0.87 

-0.58 

0.45 

1.10 

8 

6 

3MD89 

1.89 

118 

62 

0.21 

1.00 

0.07 

1.03 

0.31 

0.44 

0.97 

8 

7 

30129 

-1.77 

48 

43 

0.49 

0.96 

0.00 

1.14 

0.42 

0.25 

0.98 

8 

8 

30450 

-1.20 

57 

48 

0.39 

0.85 

-0.57 

0.57 

-0.97 

0.51 

1.19 

8 

9 

30432 

-0.80 

57 

44 

0.34 

1.12 

0.72 

1.18 

0.69 

0.21 

0.82 

8 

10 

3G153 

-0.31 

108 

88 

0.27 

1.06 

0.43 

1.04 

0.24 

0.29 

0.92 

8 

11 

31018 

0.46 

45 

29 

0.34 

1.15 

1.09 

1.30 

1.07 

0.27 

0.56 

8 

12 

3G11 

0.91 

117 

70 

0.21 

0.94 

-0.62 

0.87 

-0.92 

0.50 

1.17 

8 

13 

30893 

1.49 

59 

22 

0.29 

1.13 

1.10 

1.18 

1.05 

0.27 

0.66 

8 

14 

30545 

-1.41 

56 

47 

0.40 

0.79 

-0.82 

0.61 

-0.86 

0.54 

1.21 

8 

15 

30386 

-1.09 

56 

47 

0.40 

0.90 

-0.32 

0.65 

-0.85 

0.44 

1.14 

8 

16 

30056 

-0.89 

51 

40 

0.37 

0.93 

-0.34 

0.71 

-0.58 

0.43 

1.15 

8 

17 

30838 

-0.33 

57 

40 

0.32 

0.96 

-0.20 

0.94 

-0.22 

0.43 

1.07 

8 

18 

30969 

0.26 

48 

27 

0.33 

0.77 

-1.91 

0.68 

-1.68 

0.64 

1.61 

8 

19 

30679 

1.54 

64 

22 

0.30 

0.94 

-0.41 

0.88 

-0.52 

0.51 

1.13 

8 

20 

30690 

3.09 

53 

7 

0.45 

0.98 

0.05 

0.95 

0.08 

0.41 

1.00 

8 

21 

30629 

-1.14 

67 

57 

0.37 

0.87 

-0.56 

0.55 

-1.01 

0.44 

1.18 

8 

22 

30198 

-0.84 

55 

41 

0.33 

0.87 

-0.78 

0.85 

-0.44 

0.48 

1.20 

8 

23 

30497 

-0.49 

61 

45 

0.31 

1.09 

0.66 

0.97 

-0.02 

0.30 

0.88 

8 

24 

30913 

0.48 

57 

32 

0.29 

0.96 

-0.34 

0.90 

-0.59 

0.44 

1.16 

8 

25 

30929 

0.75 

303 

199 

0.14 

0.87 

-2.35 

0.79 

-1.77 

0.54 

1.28 

8 

26 

30926 

1.38 

57 

22 

0.30 

1.12 

1.00 

1.50 

2.47 

0.29 

0.55 

8 

27 

30180 

2.34 

52 

11 

0.37 

0.96 

-0.15 

0.82 

-0.25 

0.38 

1.08 

8 

28 

3NBT111 

0.29 

109 

87 

0.27 

0.87 

-0.90 

0.80 

-0.60 

0.50 

1.15 

8 

29 

3NBT16 

0.70 

116 

85 

0.23 

0.90 

-0.94 

0.82 

-0.92 

0.44 

1.19 

8 

30 

3NBT221 

1.17 

108 

61 

0.22 

0.91 

-1.04 

0.90 

-0.76 

0.50 

1.23 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

9 

1 

3NF234 

-0.58 

111 

101 

0.35 

0.93 

-0.22 

0.61 

-0.79 

0.34 

1.08 

9 

2 

3NF276 

0.63 

106 

72 

0.23 

1.09 

0.96 

0.98 

-0.05 

0.37 

0.86 

9 

3 

3NF250 

1.28 

121 

75 

0.21 

1.05 

0.61 

0.97 

-0.12 

0.40 

0.91 

9 

4 

3MD53 

-0.53 

111 

101 

0.35 

0.99 

0.04 

1.39 

0.82 

0.24 

0.97 

9 

5 

3MD37 

0.91 

125 

85 

0.22 

0.92 

-0.83 

0.83 

-0.93 

0.51 

1.17 

9 

6 

3MD27 

1.89 

125 

70 

0.20 

0.96 

-0.53 

0.92 

-0.60 

0.47 

1.13 

9 

7 

30711 

-1.79 

50 

46 

0.53 

1.05 

0.26 

0.97 

0.20 

0.12 

0.97 

9 

8 

30103 

-1.18 

57 

49 

0.41 

0.99 

0.06 

0.88 

-0.06 

0.36 

1.01 

9 

9 

30554 

-0.82 

41 

33 

0.42 

1.05 

0.27 

0.85 

-0.19 

0.34 

0.99 

9 

10 

31042 

-0.30 

57 

39 

0.31 

1.04 

0.35 

0.95 

-0.16 

0.35 

0.96 

9 

11 

30569 

0.45 

57 

34 

0.30 

0.93 

-0.55 

0.85 

-0.52 

0.50 

1.20 

9 

12 

3G144 

0.92 

116 

77 

0.22 

1.10 

1.11 

1.08 

0.50 

0.33 

0.78 

9 

13 

31161 

1.50 

66 

29 

0.27 

0.99 

-0.03 

0.96 

-0.21 

0.42 

1.03 

9 

14 

30836 

-1.39 

60 

50 

0.37 

0.97 

-0.05 

1.11 

0.44 

0.30 

0.99 

9 

15 

30964 

-1.14 

59 

51 

0.40 

1.07 

0.35 

1.23 

0.61 

0.19 

0.91 

9 

16 

30357 

-0.86 

76 

60 

0.31 

0.99 

-0.01 

0.81 

-0.46 

0.45 

1.05 

9 

17 

30976 

-0.33 

50 

35 

0.33 

1.04 

0.31 

1.13 

0.61 

0.29 

0.88 

9 

18 

30372 

0.29 

273 

217 

0.17 

1.17 

1.85 

1.12 

0.64 

0.32 

0.81 

9 

19 

30531 

1.46 

292 

160 

0.13 

0.87 

-2.40 

0.84 

-1.58 

0.55 

1.31 

9 

20 

30693 

3.16 

62 

8 

0.40 

0.95 

-0.09 

0.61 

-0.82 

0.41 

1.10 

9 

21 

30167 

-1.13 

58 

47 

0.37 

0.84 

-0.75 

0.84 

-0.26 

0.48 

1.16 

9 

22 

30303 

-0.83 

56 

41 

0.34 

0.77 

-1.51 

0.61 

-1.16 

0.59 

1.39 

9 

23 

30795 

-0.49 

66 

46 

0.29 

0.88 

-0.94 

0.79 

-0.98 

0.47 

1.27 

9 

24 

30947 

0.46 

62 

37 

0.30 

0.96 

-0.27 

0.91 

-0.36 

0.50 

1.10 

9 

25 

30178 

0.75 

47 

25 

0.33 

0.79 

-1.75 

0.70 

-1.24 

0.60 

1.59 

9 

26 

30A819 

1.39 

106 

57 

0.22 

1.09 

1.07 

1.14 

1.00 

0.39 

0.75 

9 

27 

30485 

2.25 

59 

12 

0.36 

0.97 

-0.08 

1.14 

0.48 

0.41 

1.02 

9 

28 

3NBT32 

0.26 

111 

89 

0.26 

0.87 

-0.93 

0.64 

-1.21 

0.49 

1.20 

9 

29 

3NBT212 

0.68 

116 

82 

0.22 

0.99 

-0.08 

0.89 

-0.48 

0.41 

1.05 

9 

30 

3NBT217 

1.22 

111 

75 

0.22 

0.92 

-0.86 

0.86 

-0.82 

0.46 

1.19 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

10 

1 

3NF221 

-1.00 

118 

109 

0.37 

0.96 

-0.04 

0.77 

-0.20 

0.30 

1.04 

10 

2 

3NF275 

0.66 

111 

87 

0.25 

1.09 

0.72 

0.94 

-0.13 

0.33 

0.92 

10 

3 

3NF320 

1.69 

216 

126 

0.16 

0.80 

-3.18 

0.77 

-2.17 

0.62 

1.42 

10 

4 

3MD82 

-0.59 

225 

200 

0.22 

0.85 

-0.96 

0.65 

-1.33 

0.41 

1.13 

10 

5 

3MD75 

0.88 

123 

84 

0.22 

1.21 

2.03 

1.26 

1.36 

0.30 

0.61 

10 

6 

3MD86 

1.90 

107 

45 

0.22 

1.10 

1.13 

1.30 

2.15 

0.36 

0.66 

10 

7 

30424 

-1.79 

51 

45 

0.46 

0.95 

-0.07 

0.70 

-0.30 

0.34 

1.06 

10 

8 

30416 

-1.17 

47 

40 

0.43 

1.01 

0.11 

0.80 

-0.35 

0.30 

1.03 

10 

9 

30441 

-0.82 

60 

47 

0.36 

0.81 

-0.89 

0.73 

-0.63 

0.57 

1.20 

10 

10 

31155 

-0.29 

59 

42 

0.31 

0.88 

-0.78 

0.93 

-0.22 

0.48 

1.18 

10 

11 

3G122 

0.45 

118 

92 

0.25 

1.14 

1.08 

1.15 

0.59 

0.31 

0.80 

10 

12 

31025 

0.99 

43 

21 

0.33 

1.17 

1.51 

1.23 

1.63 

0.21 

0.26 

10 

13 

30737 

1.52 

41 

17 

0.35 

1.14 

0.93 

1.20 

1.00 

0.33 

0.66 

10 

14 

30503 

-1.47 

56 

49 

0.43 

0.92 

-0.18 

0.70 

-0.42 

0.39 

1.08 

10 

15 

30239 

-1.10 

59 

49 

0.38 

1.16 

0.79 

1.50 

1.09 

0.23 

0.79 

10 

16 

30529 

-0.72 

62 

47 

0.31 

0.86 

-0.90 

0.72 

-1.04 

0.47 

1.26 

10 

17 

30669 

-0.34 

3032 

2157 

0.04 

1.04 

1.76 

1.04 

1.15 

0.37 

0.93 

10 

18 

30374 

0.25 

56 

33 

0.31 

1.00 

0.06 

0.91 

-0.34 

0.46 

1.04 

10 

19 

30398 

1.54 

57 

20 

0.30 

1.04 

0.37 

1.10 

0.55 

0.35 

0.88 

10 

20 

30084 

2.67 

55 

9 

0.40 

1.12 

0.54 

1.02 

0.18 

0.28 

0.90 

10 

21 

30314 

-1.17 

56 

44 

0.35 

0.85 

-0.77 

0.95 

-0.07 

0.45 

1.16 

10 

22 

30302 

-0.84 

56 

46 

0.37 

0.95 

-0.16 

0.79 

-0.42 

0.37 

1.08 

10 

23 

30021 

-0.48 

62 

43 

0.31 

1.14 

1.01 

1.08 

0.41 

0.32 

0.77 

10 

24 

30042 

0.48 

57 

32 

0.30 

0.89 

-0.97 

0.81 

-1.09 

0.54 

1.35 

10 

25 

30632 

0.75 

56 

24 

0.30 

0.96 

-0.31 

0.92 

-0.41 

0.47 

1.13 

10 

26 

3OA620 

1.41 

114 

65 

0.21 

0.97 

-0.37 

0.96 

-0.26 

0.45 

1.08 

10 

27 

30033 

2.14 

58 

16 

0.32 

0.89 

-0.67 

0.93 

-0.17 

0.47 

1.15 

10 

28 

3NBT124 

0.30 

110 

80 

0.24 

1.09 

0.82 

1.02 

0.19 

0.33 

0.87 

10 

29 

3NBT12 

0.69 

111 

85 

0.24 

0.90 

-0.82 

0.74 

-1.15 

0.45 

1.18 

10 

30 

3NBT215 

1.24 

106 

60 

0.22 

1.02 

0.29 

1.29 

1.86 

0.41 

0.83 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

BMF 

1 

3NF29 

-1.15 

106 

98 

0.39 

0.98 

0.03 

1.12 

0.39 

0.26 

1.00 

BMF 

2 

3NF274 

0.86 

122 

91 

0.23 

1.11 

0.98 

1.18 

0.85 

0.30 

0.82 

BMF 

3 

3NF317 

1.44 

106 

56 

0.22 

0.90 

-1.15 

0.81 

-1.41 

0.55 

1.29 

BMF 

4 

3MD211 

-0.95 

117 

107 

0.35 

0.90 

-0.33 

0.60 

-0.85 

0.40 

1.09 

BMF 

5 

3MD26 

0.81 

117 

80 

0.22 

0.89 

-1.24 

0.77 

-1.27 

0.49 

1.27 

BMF 

6 

3MD113 

1.47 

129 

75 

0.20 

0.96 

-0.44 

0.93 

-0.49 

0.50 

1.09 

BMF 

7 

30412 

-1.71 

58 

52 

0.45 

1.10 

0.41 

1.39 

0.77 

0.17 

0.90 

BMF 

8 

30402 

-1.27 

39 

33 

0.48 

0.80 

-0.64 

0.58 

-0.61 

0.45 

1.22 

BMF 

9 

3G119 

-0.69 

225 

202 

0.23 

0.90 

-0.55 

0.68 

-1.12 

0.37 

1.09 

BMF 

10 

31016 

-0.38 

48 

37 

0.37 

1.06 

0.37 

1.11 

0.41 

0.31 

0.92 

BMF 

11 

3G135 

0.32 

121 

95 

0.24 

0.99 

-0.03 

0.81 

-0.64 

0.36 

1.05 

BMF 

12 

31197 

0.86 

36 

18 

0.37 

1.32 

2.22 

1.40 

2.05 

0.10 

-0.04 

BMF 

13 

30861 

1.54 

57 

20 

0.30 

1.24 

1.84 

1.41 

1.87 

0.18 

0.35 

BMF 

14 

30509 

-1.44 

393 

368 

0.22 

0.97 

-0.13 

0.78 

-0.51 

0.31 

1.04 

BMF 

15 

30054 

-1.18 

50 

43 

0.43 

1.03 

0.20 

0.97 

0.07 

0.28 

0.99 

BMF 

16 

30360 

-0.73 

55 

43 

0.34 

1.07 

0.45 

1.15 

0.57 

0.20 

0.86 

BMF 

17 

30841 

-0.21 

57 

39 

0.31 

0.90 

-0.77 

0.84 

-0.82 

0.48 

1.24 

BMF 

18 

30223 

0.22 

58 

31 

0.30 

1.13 

1.03 

1.06 

0.41 

0.39 

0.75 

BMF 

19 

30991 

1.22 

56 

23 

0.30 

0.89 

-1.06 

0.83 

-0.76 

0.50 

1.36 

BMF 

20 

30231 

3.13 

52 

7 

0.43 

1.04 

0.23 

1.17 

0.50 

0.24 

0.95 

BMF 

21 

30152 

-1.24 

57 

47 

0.37 

0.94 

-0.23 

0.84 

-0.27 

0.38 

1.08 

BMF 

22 

30319 

-0.89 

57 

45 

0.35 

0.88 

-0.63 

0.70 

-0.85 

0.49 

1.19 

BMF 

23 

30315 

-0.47 

52 

37 

0.34 

0.92 

-0.42 

0.81 

-0.54 

0.49 

1.15 

BMF 

24 

30A516 

0.48 

116 

89 

0.24 

0.86 

-1.18 

0.72 

-1.30 

0.47 

1.23 

BMF 

25 

30784 

0.72 

54 

27 

0.30 

0.84 

-1.60 

0.79 

-1.22 

0.54 

1.56 

BMF 

26 

30931 

1.34 

59 

21 

0.31 

0.92 

-0.55 

0.97 

-0.08 

0.50 

1.12 

BMF 

27 

30470 

2.46 

56 

10 

0.38 

0.98 

-0.02 

1.03 

0.22 

0.35 

1.00 

BMF 

28 

3NBT13 

0.24 

117 

91 

0.24 

0.86 

-1.18 

0.67 

-1.33 

0.47 

1.24 

BMF 

29 

3NBT121 

0.84 

118 

85 

0.23 

1.22 

1.90 

1.47 

1.90 

0.29 

0.62 

BMF 

30 

3NBT17 

1.06 

108 

70 

0.22 

1.04 

0.50 

1.02 

0.17 

0.38 

0.92 

Note.  BMF  = Benchmark  Fall. 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

BMF 

31 

41093 

-0.89 

46 

36 

0.39 

0.74 

-1.34 

0.52 

-1.22 

0.61 

1.37 

BMF 

32 

40A416 

-0.41 

119 

99 

0.26 

0.85 

-1.01 

0.59 

-1.32 

0.46 

1.20 

BMF 

33 

4G330 

0.42 

89 

65 

0.26 

0.95 

-0.40 

0.86 

-0.64 

0.40 

1.12 

BMF 

34 

40A29 

0.98 

92 

57 

0.23 

0.85 

-1.84 

0.83 

-1.20 

0.51 

1.44 

BMF 

35 

40A57 

1.55 

89 

50 

0.23 

0.95 

-0.61 

0.92 

-0.67 

0.42 

1.20 

BMF 

36 

2G335 

-0.98 

84 

75 

0.37 

0.87 

-0.44 

0.69 

-0.44 

0.38 

1.11 

BMF 

37 

23158 

-0.53 

45 

37 

0.44 

0.77 

-0.94 

0.61 

-0.63 

0.52 

1.27 

BMF 

38 

22183 

0.35 

2521 

1723 

0.05 

0.96 

-1.57 

0.91 

-2.07 

0.51 

1.07 

BMF 

39 

2NBT67 

0.76 

85 

56 

0.25 

0.94 

-0.58 

0.85 

-0.86 

0.47 

1.17 

BMF 

40 

22344 

1.56 

44 

19 

0.35 

0.77 

-1.73 

0.71 

-1.63 

0.61 

1.61 

Note.  BMF  = Benchmark  Fall. 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

BMW 

1 

3NF26 

-1.10 

123 

116 

0.40 

0.91 

-0.18 

0.57 

-0.60 

0.33 

1.08 

BMW 

2 

3NF274 

0.86 

122 

91 

0.23 

1.11 

0.98 

1.18 

0.85 

0.30 

0.82 

BMW 

3 

3NF265 

1.42 

120 

71 

0.21 

1.01 

0.15 

0.96 

-0.25 

0.44 

1.01 

BMW 

4 

3MD59 

-0.94 

116 

107 

0.36 

0.93 

-0.15 

0.70 

-0.54 

0.29 

1.06 

BMW 

5 

3MD87 

0.82 

107 

78 

0.25 

1.16 

1.26 

1.04 

0.26 

0.41 

0.81 

BMW 

6 

3MD16 

1.47 

220 

118 

0.15 

1.06 

0.96 

1.15 

1.71 

0.39 

0.80 

BMW 

7 

30413 

-1.71 

42 

38 

0.54 

0.99 

0.12 

0.69 

-0.21 

0.26 

1.04 

BMW 

8 

30871 

-1.27 

41 

36 

0.49 

1.12 

0.46 

1.25 

0.59 

0.08 

0.87 

BMW 

9 

3G17 

-0.69 

108 

97 

0.35 

1.12 

0.58 

1.23 

0.58 

0.26 

0.88 

BMW 

10 

31184 

-0.38 

56 

40 

0.34 

1.29 

1.68 

1.37 

1.03 

0.25 

0.52 

BMW 

11 

3G135 

0.32 

121 

95 

0.24 

0.99 

-0.03 

0.81 

-0.64 

0.36 

1.05 

BMW 

12 

3G117 

0.86 

113 

85 

0.24 

0.87 

-1.07 

0.73 

-1.11 

0.50 

1.21 

BMW 

13 

31190 

1.53 

57 

20 

0.32 

1.15 

1.03 

1.37 

1.38 

0.35 

0.68 

BMW 

14 

30509 

-1.44 

393 

368 

0.22 

0.97 

-0.13 

0.78 

-0.51 

0.31 

1.04 

BMW 

15 

30236 

-1.18 

61 

49 

0.35 

0.86 

-0.68 

0.84 

-0.34 

0.45 

1.15 

BMW 

16 

30388 

-0.74 

56 

42 

0.34 

1.12 

0.73 

1.09 

0.39 

0.33 

0.83 

BMW 

17 

30841 

-0.21 

57 

39 

0.31 

0.90 

-0.77 

0.84 

-0.82 

0.48 

1.24 

BMW 

18 

30684 

0.22 

63 

41 

0.29 

1.03 

0.25 

1.00 

0.05 

0.39 

0.96 

BMW 

19 

30091 

1.28 

58 

23 

0.30 

1.00 

0.05 

1.08 

0.48 

0.44 

0.96 

BMW 

20 

30681 

3.13 

66 

10 

0.37 

0.92 

-0.30 

0.87 

-0.09 

0.39 

1.07 

BMW 

21 

30200 

-1.24 

55 

47 

0.41 

1.01 

0.12 

1.09 

0.34 

0.33 

1.00 

BMW 

22 

30911 

-0.89 

54 

44 

0.37 

1.12 

0.63 

1.06 

0.27 

0.18 

0.87 

BMW 

23 

30342 

-0.47 

60 

42 

0.30 

0.81 

-1.44 

0.69 

-1.24 

0.54 

1.42 

BMW 

24 

30A43 

0.48 

107 

83 

0.27 

0.85 

-1.11 

0.63 

-1.44 

0.55 

1.24 

BMW 

25 

30785 

0.72 

56 

30 

0.29 

0.87 

-1.40 

0.78 

-0.78 

0.50 

1.52 

BMW 

26 

30A63 

1.34 

122 

81 

0.21 

0.98 

-0.19 

1.24 

1.40 

0.40 

0.96 

BMW 

27 

30794 

2.40 

59 

11 

0.36 

1.02 

0.16 

1.06 

0.28 

0.31 

0.96 

BMW 

28 

3NBT229 

0.24 

111 

93 

0.28 

0.90 

-0.54 

0.77 

-0.60 

0.41 

1.11 

BMW 

29 

3NBT323 

0.82 

107 

78 

0.25 

0.83 

-1.39 

0.66 

-1.58 

0.58 

1.29 

BMW 

30 

3NBT325 

1.06 

119 

81 

0.22 

1.01 

0.09 

0.92 

-0.39 

0.41 

1.01 

Note.  BMW  = Benchmark  Winter. 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

BMW 

31 

40297 

-0.89 

60 

47 

0.36 

0.86 

-0.66 

0.67 

-0.61 

0.51 

1.19 

BMW 

32 

40A412 

-0.41 

89 

74 

0.29 

0.95 

-0.25 

0.78 

-0.71 

0.32 

1.09 

BMW 

33 

4G119 

0.41 

113 

82 

0.23 

1.32 

2.81 

1.49 

2.66 

0.01 

0.38 

BMW 

34 

40A124 

1.01 

106 

66 

0.22 

0.96 

-0.50 

0.93 

-0.49 

0.40 

1.13 

BMW 

35 

40  A3 11 

1.53 

90 

36 

0.24 

1.11 

1.23 

1.21 

1.62 

0.27 

0.63 

BMW 

36 

2G18 

-1.01 

74 

65 

0.38 

1.22 

0.92 

1.25 

0.62 

0.13 

0.81 

BMW 

37 

23057 

-0.53 

44 

36 

0.44 

0.72 

-1.12 

0.64 

-0.62 

0.61 

1.27 

BMW 

38 

22215 

0.35 

43 

29 

0.38 

0.97 

-0.15 

1.12 

0.48 

0.48 

0.99 

BMW 

39 

21883 

0.76 

45 

27 

0.36 

1.04 

0.29 

0.96 

-0.08 

0.50 

0.95 

BMW 

40 

22181 

1.56 

45 

22 

0.34 

1.01 

0.10 

0.97 

-0.07 

0.47 

1.00 

Note.  BMW  = Benchmark  Winter. 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

BMS 

1 

3NF28 

-1.08 

111 

103 

0.39 

0.95 

-0.08 

0.63 

-0.45 

0.31 

1.05 

BMS 

2 

3NF259 

0.88 

116 

78 

0.22 

1.02 

0.21 

0.92 

-0.41 

0.40 

1.00 

BMS 

3 

3NF280 

1.40 

116 

70 

0.21 

0.96 

-0.50 

0.90 

-0.78 

0.44 

1.15 

BMS 

4 

3MD51 

-0.98 

119 

110 

0.36 

0.98 

0.02 

1.06 

0.28 

0.26 

1.01 

BMS 

5 

3MD25 

0.83 

127 

88 

0.22 

0.80 

-2.14 

0.65 

-2.06 

0.60 

1.39 

BMS 

6 

3MD33 

1.47 

110 

56 

0.21 

1.08 

0.95 

1.16 

1.33 

0.38 

0.73 

BMS 

7 

31019 

-1.71 

36 

32 

0.54 

0.87 

-0.21 

0.57 

-0.40 

0.36 

1.14 

BMS 

8 

3G110 

-1.27 

251 

235 

0.27 

0.87 

-0.61 

0.53 

-1.24 

0.35 

1.10 

BMS 

9 

3G211 

-0.69 

108 

97 

0.35 

0.89 

-0.44 

0.77 

-0.29 

0.40 

1.10 

BMS 

10 

30704 

-0.36 

40 

30 

0.40 

1.21 

1.14 

1.44 

1.11 

0.16 

0.57 

BMS 

11 

31165 

0.31 

63 

35 

0.28 

0.88 

-1.15 

0.82 

-1.20 

0.53 

1.38 

BMS 

12 

3G129 

0.86 

125 

86 

0.22 

1.08 

0.78 

1.14 

0.76 

0.39 

0.86 

BMS 

13 

30900 

1.53 

302 

158 

0.13 

1.00 

-0.07 

1.00 

0.00 

0.48 

1.01 

BMS 

14 

30206 

-1.45 

57 

49 

0.41 

0.91 

-0.25 

0.84 

-0.18 

0.40 

1.07 

BMS 

15 

30236 

-1.18 

61 

49 

0.35 

0.86 

-0.68 

0.84 

-0.34 

0.45 

1.15 

BMS 

16 

30388 

-0.74 

56 

42 

0.34 

1.12 

0.73 

1.09 

0.39 

0.33 

0.83 

BMS 

17 

30527 

-0.21 

56 

40 

0.32 

0.87 

-0.91 

0.72 

-1.03 

0.50 

1.29 

BMS 

18 

30952 

0.23 

57 

34 

0.31 

1.04 

0.31 

1.30 

1.15 

0.45 

0.86 

BMS 

19 

30091 

1.28 

58 

23 

0.30 

1.00 

0.05 

1.08 

0.48 

0.44 

0.96 

BMS 

20 

30224 

3.14 

58 

8 

0.43 

0.94 

-0.13 

0.91 

0.01 

0.44 

1.03 

BMS 

21 

30155 

-1.23 

68 

58 

0.36 

0.85 

-0.60 

0.63 

-0.90 

0.46 

1.16 

BMS 

22 

31092 

-0.89 

57 

46 

0.36 

0.90 

-0.50 

0.62 

-1.01 

0.44 

1.20 

BMS 

23 

31074 

-0.46 

54 

39 

0.33 

0.93 

-0.43 

0.74 

-0.87 

0.45 

1.19 

BMS 

24 

30A43 

0.48 

107 

83 

0.27 

0.85 

-1.11 

0.63 

-1.44 

0.55 

1.24 

BMS 

25 

30942 

0.72 

55 

30 

0.30 

0.98 

-0.16 

0.94 

-0.30 

0.46 

1.08 

BMS 

26 

30772 

1.34 

51 

19 

0.32 

0.95 

-0.33 

0.88 

-0.59 

0.46 

1.15 

BMS 

27 

30794 

2.40 

59 

11 

0.36 

1.02 

0.16 

1.06 

0.28 

0.31 

0.96 

BMS 

28 

3NBT321 

0.25 

106 

83 

0.26 

0.97 

-0.16 

0.75 

-1.04 

0.44 

1.09 

BMS 

29 

3NBT220 

0.82 

107 

74 

0.23 

1.03 

0.33 

1.09 

0.55 

0.37 

0.92 

BMS 

30 

3NBT117 

1.09 

113 

81 

0.23 

1.05 

0.46 

0.96 

-0.14 

0.40 

0.95 

Note.  BMS  = Benchmark  Spring. 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

BMS 

31 

4G232 

0.41 

209 

141 

0.16 

0.91 

-1.49 

0.88 

-1.14 

0.44 

1.23 

BMS 

32 

40A37 

-0.41 

120 

98 

0.25 

0.96 

-0.21 

0.79 

-0.93 

0.38 

1.08 

BMS 

33 

40592 

-0.89 

49 

40 

0.42 

0.87 

-0.46 

0.74 

-0.42 

0.53 

1.13 

BMS 

34 

40A418 

1.04 

105 

65 

0.22 

1.08 

0.98 

1.10 

0.80 

0.30 

0.75 

BMS 

35 

40A54 

1.53 

224 

116 

0.15 

1.03 

0.61 

1.02 

0.25 

0.42 

0.91 

BMS 

36 

2G327 

-1.02 

68 

62 

0.46 

0.86 

-0.34 

1.22 

0.53 

0.34 

1.03 

BMS 

37 

23333 

-0.53 

45 

35 

0.41 

0.86 

-0.63 

0.70 

-0.55 

0.51 

1.20 

BMS 

38 

22110 

0.35 

43 

30 

0.40 

0.85 

-0.79 

1.21 

0.64 

0.56 

1.16 

BMS 

39 

2NBT33 

0.76 

66 

50 

0.33 

1.00 

0.03 

0.99 

0.08 

0.44 

1.00 

BMS 

40 

22316 

1.56 

45 

24 

0.37 

1.01 

0.09 

1.01 

0.13 

0.57 

0.98 

Note.  BMS  = Benchmark  Spring. 
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Appendix  C:  Distractor  by  Test  Form 


Appendix  C:  Distractor  Statistics  by  Test  Form 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

1 

1 

3NF25 

* 

-1 

4884 

98 

1.18 

0.02 

0.00 

-0.11 

1 

1 

3NF25 

A 

1 

100 

91 

2.28 

0.11 

0.97 

0.31 

1 

1 

3NF25 

B 

0 

6 

5 

0.79 

0.25 

0.44 

-0.30 

1 

1 

3NF25 

C 

0 

4 

4 

1.51 

0.67 

1.78 

-0.11 

1 

1 

3NF25 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

2 

3NF258 

* 

-1 

4870 

98 

1.19 

0.02 

0.00 

-0.08 

1 

2 

3NF258 

A 

1 

86 

69 

2.27 

0.13 

1.02 

0.44 

1 

2 

3NF258 

B 

0 

21 

17 

0.95 

0.24 

0.94 

-0.34 

1 

2 

3NF258 

C 

0 

17 

14 

1.22 

0.22 

0.97 

-0.21 

1 

2 

3NF258 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

3 

3NF316 

* 

-1 

4884 

98 

1.18 

0.02 

0.00 

-0.12 

1 

3 

3NF316 

A 

1 

74 

67 

2.77 

0.13 

0.87 

0.54 

1 

3 

3NF316 

B 

0 

23 

21 

1.42 

0.18 

0.78 

-0.37 

1 

3 

3NF316 

C 

0 

13 

12 

1.24 

0.22 

0.59 

-0.32 

1 

3 

3NF316 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

4 

3MD411 

* 

-1 

4748 

95 

1.16 

0.02 

0.00 

-0.14 

1 

4 

3MD411 

A 

1 

225 

91 

2.15 

0.07 

0.91 

0.38 

1 

4 

3MD411 

B 

0 

15 

6 

0.49 

0.19 

0.48 

-0.34 

1 

4 

3MD411 

C 

0 

6 

2 

0.83 

0.26 

0.59 

-0.16 

1 

4 

3MD411 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

5 

3MD83 

* 

-1 

4884 

98 

1.19 

0.02 

0.00 

-0.10 

1 

5 

3MD83 

A 

1 

83 

75 

2.51 

0.13 

0.79 

0.54 

1 

5 

3MD83 

B 

0 

20 

18 

0.89 

0.26 

1.44 

-0.43 

1 

5 

3MD83 

C 

0 

7 

6 

0.67 

0.22 

0.40 

-0.28 

1 

5 

3MD83 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

6 

3MD310 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.11 

1 

6 

3MD310 

A 

1 

69 

62 

2.39 

0.14 

1.21 

0.27 

1 

6 

3MD310 

B 

0 

27 

24 

1.75 

0.15 

1.07 

-0.20 

1 

6 

3MD310 

C 

0 

15 

14 

1.82 

0.32 

1.73 

-0.12 

1 

6 

3MD310 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

1 

7 

3G219 

* 

-1 

4888 

98 

1.20 

0.02 

0.00 

-0.04 

1 

7 

3G219 

A 

1 

100 

94 

1.69 

0.11 

0.93 

0.27 

1 

7 

3G219 

B 

0 

4 

4 

0.65 

0.70 

1.15 

-0.16 

1 

7 

3G219 

C 

0 

2 

2 

-0.43 

0.29 

0.23 

-0.24 

1 

7 

3G219 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

8 

31152 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.04 

1 

8 

31152 

A 

1 

45 

83 

0.93 

0.19 

0.98 

0.31 

1 

8 

31152 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

8 

31152 

C 

0 

7 

13 

-0.06 

0.47 

1.12 

-0.25 

1 

8 

31152 

D 

0 

2 

4 

-0.42 

0.14 

0.49 

-0.18 

1 

9 

31157 

* 

-1 

4951 

99 

1.21 

0.02 

0.00 

0.03 

1 

9 

31157 

A 

1 

33 

77 

1.01 

0.19 

1.02 

0.38 

1 

9 

31157 

B 

0 

7 

16 

0.31 

0.24 

1.02 

-0.18 

1 

9 

31157 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

9 

31157 

D 

0 

3 

7 

-0.71 

0.44 

0.37 

-0.37 

1 

10 

31167 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.04 

1 

10 

31167 

A 

1 

38 

69 

1.09 

0.18 

0.90 

0.51 

1 

10 

31167 

B 

0 

4 

7 

-0.42 

0.35 

0.50 

-0.26 

1 

10 

31167 

C 

0 

4 

7 

-0.46 

0.69 

0.74 

-0.27 

1 

10 

31167 

D 

0 

9 

16 

-0.06 

0.29 

0.91 

-0.27 

1 

11 

3G123 

* 

-1 

4874 

98 

1.19 

0.02 

0.00 

-0.08 

1 

11 

3G123 

A 

1 

94 

78 

2.08 

0.11 

1.02 

0.30 

1 

11 

3G123 

B 

0 

21 

18 

1.46 

0.19 

1.26 

-0.19 

1 

11 

3G123 

C 

0 

5 

4 

0.66 

0.24 

0.42 

-0.24 

1 

11 

3G123 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

12 

3G124 

* 

-1 

4876 

98 

1.19 

0.02 

0.00 

-0.07 

1 

12 

3G124 

A 

1 

83 

70 

2.10 

0.11 

1.06 

0.41 

1 

12 

3G124 

B 

0 

17 

14 

1.38 

0.22 

1.07 

-0.17 

1 

12 

3G124 

C 

0 

18 

15 

0.97 

0.21 

0.71 

-0.35 

1 

12 

3G124 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

1 

13 

3G141 

* 

-1 

4880 

98 

1.19 

0.02 

0.00 

-0.10 

1 

13 

3G141 

A 

1 

71 

62 

2.34 

0.15 

1.22 

0.30 

1 

13 

3G141 

B 

0 

29 

25 

1.63 

0.18 

1.18 

-0.20 

1 

13 

3G141 

C 

0 

14 

12 

1.49 

0.30 

1.31 

-0.17 

1 

13 

3G141 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

14 

30667 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.04 

1 

14 

30667 

A 

1 

46 

85 

0.90 

0.17 

0.88 

0.43 

1 

14 

30667 

B 

0 

1 

2 

-0.42 

0.00 

0.55 

-0.12 

1 

14 

30667 

C 

0 

3 

6 

-0.70 

0.86 

0.81 

-0.26 

1 

14 

30667 

D 

0 

4 

7 

-0.68 

0.61 

0.73 

-0.30 

1 

15 

30240 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.05 

1 

15 

30240 

A 

1 

48 

81 

0.85 

0.17 

1.06 

0.35 

1 

15 

30240 

B 

0 

5 

8 

-0.13 

0.29 

0.80 

-0.20 

1 

15 

30240 

C 

0 

4 

7 

-0.52 

0.38 

0.53 

-0.27 

1 

15 

30240 

D 

0 

2 

3 

0.20 

0.09 

0.92 

-0.07 

1 

16 

30842 

* 

-1 

4946 

99 

1.21 

0.02 

0.00 

0.02 

1 

16 

30842 

A 

1 

39 

81 

1.23 

0.19 

0.90 

0.39 

1 

16 

30842 

B 

0 

1 

2 

0.54 

0.00 

0.92 

-0.05 

1 

16 

30842 

C 

0 

3 

6 

-0.43 

0.78 

0.53 

-0.30 

1 

16 

30842 

D 

0 

5 

10 

0.13 

0.40 

0.84 

-0.24 

1 

17 

30972 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.06 

1 

17 

30972 

A 

1 

36 

64 

0.75 

0.19 

1.06 

0.31 

1 

17 

30972 

B 

0 

10 

18 

0.45 

0.18 

1.26 

-0.02 

1 

17 

30972 

C 

0 

3 

5 

-0.37 

0.54 

0.66 

-0.19 

1 

17 

30972 

D 

0 

7 

13 

-0.34 

0.40 

0.68 

-0.30 

1 

18 

30097 

* 

-1 

4937 

99 

1.22 

0.02 

0.00 

0.07 

1 

18 

30097 

A 

1 

31 

54 

1.18 

0.21 

0.73 

0.58 

1 

18 

30097 

B 

0 

9 

16 

-0.14 

0.15 

0.67 

-0.13 

1 

18 

30097 

C 

0 

1 

2 

0.34 

0.00 

0.99 

0.00 

1 

18 

30097 

D 

0 

16 

28 

-1.03 

0.45 

0.61 

-0.54 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

1 

19 

30821 

* 

-1 

4717 

94 

1.18 

0.02 

0.00 

-0.07 

1 

19 

30821 

A 

1 

157 

57 

2.23 

0.11 

0.99 

0.48 

1 

19 

30821 

B 

0 

86 

31 

0.94 

0.11 

1.04 

-0.31 

1 

19 

30821 

C 

0 

25 

9 

0.96 

0.18 

0.90 

-0.14 

1 

19 

30821 

D 

0 

9 

3 

-0.81 

0.74 

0.39 

-0.30 

1 

20 

30534 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

1 

20 

30534 

A 

1 

7 

13 

2.33 

0.66 

0.70 

0.50 

1 

20 

30534 

B 

0 

32 

57 

0.63 

0.14 

0.90 

-0.08 

1 

20 

30534 

C 

0 

9 

16 

0.69 

0.38 

1.33 

-0.01 

1 

20 

30534 

D 

0 

8 

14 

-0.32 

0.41 

0.42 

-0.34 

1 

21 

30188 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.03 

1 

21 

30188 

A 

1 

49 

84 

0.98 

0.16 

0.97 

0.34 

1 

21 

30188 

B 

0 

4 

7 

0.09 

0.21 

0.72 

-0.18 

1 

21 

30188 

C 

0 

3 

5 

-0.36 

0.67 

0.60 

-0.25 

1 

21 

30188 

D 

0 

2 

3 

0.15 

0.46 

0.79 

-0.12 

1 

22 

30312 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.05 

1 

22 

30312 

A 

1 

43 

75 

1.05 

0.20 

0.84 

0.51 

1 

22 

30312 

B 

0 

4 

7 

-0.92 

0.14 

0.34 

-0.26 

1 

22 

30312 

C 

0 

3 

5 

0.90 

0.08 

2.07 

0.05 

1 

22 

30312 

D 

0 

7 

12 

-1.48 

0.69 

0.49 

-0.49 

1 

23 

30047 

* 

-1 

4690 

94 

1.17 

0.02 

0.00 

-0.11 

1 

23 

30047 

A 

1 

264 

87 

2.02 

0.07 

0.90 

0.45 

1 

23 

30047 

B 

0 

19 

6 

0.38 

0.17 

0.51 

-0.30 

1 

23 

30047 

C 

0 

16 

5 

0.54 

0.22 

0.67 

-0.24 

1 

23 

30047 

D 

0 

5 

2 

0.02 

0.27 

0.31 

-0.19 

1 

24 

30341 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.04 

1 

24 

30341 

A 

1 

33 

55 

1.23 

0.15 

0.77 

0.53 

1 

24 

30341 

B 

0 

6 

10 

-0.07 

0.44 

0.76 

-0.23 

1 

24 

30341 

C 

0 

14 

23 

0.32 

0.30 

1.24 

-0.18 

1 

24 

30341 

D 

0 

7 

12 

-0.45 

0.29 

0.42 

-0.37 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

1 

25 

30471 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.05 

1 

25 

30471 

A 

1 

26 

47 

1.10 

0.15 

0.82 

0.54 

1 

25 

30471 

B 

0 

8 

15 

0.50 

0.34 

1.34 

-0.04 

1 

25 

30471 

C 

0 

7 

13 

0.26 

0.10 

0.73 

-0.14 

1 

25 

30471 

D 

0 

14 

25 

-0.14 

0.20 

0.62 

-0.48 

1 

26 

30474 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.06 

1 

26 

30474 

A 

1 

20 

36 

1.21 

0.17 

0.86 

0.39 

1 

26 

30474 

B 

0 

13 

23 

0.43 

0.28 

1.20 

-0.03 

1 

26 

30474 

C 

0 

7 

13 

0.33 

0.41 

1.04 

-0.05 

1 

26 

30474 

D 

0 

16 

29 

-0.23 

0.46 

0.92 

-0.35 

1 

27 

30777 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.03 

1 

27 

30777 

A 

1 

12 

22 

1.73 

0.52 

1.28 

0.35 

1 

27 

30777 

B 

0 

6 

11 

1.06 

0.42 

1.47 

0.06 

1 

27 

30777 

C 

0 

7 

13 

0.30 

0.59 

1.25 

-0.14 

1 

27 

30777 

D 

0 

29 

54 

0.50 

0.20 

0.95 

-0.24 

1 

28 

3NBT128 

* 

-1 

4874 

98 

1.18 

0.02 

0.00 

-0.10 

1 

28 

3NBT128 

A 

1 

99 

83 

2.24 

0.12 

0.92 

0.33 

1 

28 

3NBT128 

B 

0 

4 

3 

0.32 

0.54 

0.44 

-0.26 

1 

28 

3NBT128 

C 

0 

17 

14 

1.35 

0.31 

1.82 

-0.23 

1 

28 

3NBT128 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

29 

3NBT23 

* 

-1 

4888 

98 

1.20 

0.02 

0.00 

-0.04 

1 

29 

3NBT23 

A 

1 

69 

65 

2.01 

0.13 

0.87 

0.46 

1 

29 

3NBT23 

B 

0 

33 

31 

0.96 

0.19 

1.40 

-0.37 

1 

29 

3NBT23 

C 

0 

4 

4 

0.12 

0.37 

0.34 

-0.25 

1 

29 

3NBT23 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

30 

3NBT125 

* 

-1 

4759 

95 

1.16 

0.02 

0.00 

-0.14 

1 

30 

3NBT125 

A 

1 

160 

68 

2.43 

0.09 

0.91 

0.46 

1 

30 

3NBT125 

B 

0 

29 

12 

1.18 

0.17 

0.81 

-0.28 

1 

30 

3NBT125 

C 

0 

46 

20 

1.31 

0.11 

0.82 

-0.31 

1 

30 

3NBT125 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2 

1 

3NF228 

* 

-1 

4874 

98 

1.18 

0.02 

0.00 

-0.10 

2 

1 

3NF228 

A 

1 

111 

93 

2.17 

0.11 

0.92 

0.33 

2 

1 

3NF228 

B 

0 

4 

3 

0.83 

0.59 

0.82 

-0.18 

2 

1 

3NF228 

C 

0 

5 

4 

0.46 

0.40 

0.47 

-0.27 

2 

1 

3NF228 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

2 

3NF254 

* 

-1 

4886 

98 

1.20 

0.02 

0.00 

-0.04 

2 

2 

3NF254 

A 

1 

69 

64 

1.80 

0.15 

1.20 

0.28 

2 

2 

3NF254 

B 

0 

18 

17 

1.07 

0.18 

1.03 

-0.17 

2 

2 

3NF254 

C 

0 

21 

19 

1.10 

0.23 

1.34 

-0.18 

2 

2 

3NF254 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

3 

3NF243 

* 

-1 

4869 

97 

1.19 

0.02 

0.00 

-0.08 

2 

3 

3NF243 

A 

1 

71 

57 

2.35 

0.15 

1.32 

0.40 

2 

3 

3NF243 

B 

0 

23 

18 

1.20 

0.21 

0.87 

-0.27 

2 

3 

3NF243 

C 

0 

31 

25 

1.42 

0.16 

0.95 

-0.22 

2 

3 

3NF243 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

4 

3MD66 

* 

-1 

4871 

98 

1.18 

0.02 

0.00 

-0.12 

2 

4 

3MD66 

A 

1 

113 

92 

2.30 

0.10 

0.97 

0.26 

2 

4 

3MD66 

B 

0 

7 

6 

1.46 

0.31 

0.97 

-0.17 

2 

4 

3MD66 

C 

0 

3 

2 

0.69 

0.99 

0.91 

-0.21 

2 

4 

3MD66 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

5 

3MD312 

* 

-1 

4878 

98 

1.18 

0.02 

0.00 

-0.11 

2 

5 

3MD312 

A 

1 

88 

76 

2.56 

0.13 

0.82 

0.58 

2 

5 

3MD312 

B 

0 

18 

16 

0.65 

0.17 

0.43 

-0.48 

2 

5 

3MD312 

C 

0 

10 

9 

0.95 

0.20 

0.54 

-0.27 

2 

5 

3MD312 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

6 

3MD512 

* 

-1 

4871 

98 

1.18 

0.02 

0.00 

-0.12 

2 

6 

3MD512 

A 

1 

77 

63 

2.47 

0.13 

1.20 

0.29 

2 

6 

3MD512 

B 

0 

35 

28 

1.97 

0.15 

1.32 

-0.14 

2 

6 

3MD512 

C 

0 

11 

9 

1.20 

0.29 

0.59 

-0.28 

2 

6 

3MD512 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2 

7 

30744 

* 

-1 

4947 

99 

1.21 

0.02 

0.00 

0.04 

2 

7 

30744 

A 

1 

42 

89 

0.75 

0.14 

1.04 

0.19 

2 

7 

30744 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

7 

30744 

C 

0 

4 

9 

0.35 

0.35 

1.11 

-0.13 

2 

7 

30744 

D 

0 

1 

2 

-0.23 

0.00 

0.51 

-0.16 

2 

8 

3G115 

* 

-1 

4876 

98 

1.19 

0.02 

0.00 

-0.07 

2 

8 

3G115 

A 

1 

110 

93 

1.86 

0.11 

1.00 

0.18 

2 

8 

3G115 

B 

0 

2 

2 

1.77 

0.07 

1.54 

0.00 

2 

8 

3G115 

C 

0 

6 

5 

0.75 

0.38 

0.84 

-0.21 

2 

8 

3G115 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

9 

30290 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.02 

2 

9 

30290 

A 

1 

43 

81 

1.16 

0.14 

0.98 

0.35 

2 

9 

30290 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

9 

30290 

C 

0 

5 

9 

0.68 

0.43 

1.27 

-0.11 

2 

9 

30290 

D 

0 

5 

9 

-0.08 

0.14 

0.46 

-0.36 

2 

10 

30133 

* 

-1 

4928 

99 

1.21 

0.02 

0.00 

0.04 

2 

10 

30133 

A 

1 

47 

71 

1.02 

0.13 

0.95 

0.45 

2 

10 

30133 

B 

0 

6 

9 

0.35 

0.49 

1.42 

-0.12 

2 

10 

30133 

C 

0 

10 

15 

0.10 

0.18 

0.72 

-0.28 

2 

10 

30133 

D 

0 

3 

5 

-0.76 

0.45 

0.32 

-0.33 

2 

11 

30855 

* 

-1 

4944 

99 

1.21 

0.02 

0.00 

0.03 

2 

11 

30855 

A 

1 

28 

56 

1.47 

0.25 

0.76 

0.55 

2 

11 

30855 

B 

0 

2 

4 

0.41 

0.65 

0.98 

-0.06 

2 

11 

30855 

C 

0 

10 

20 

0.16 

0.25 

0.79 

-0.23 

2 

11 

30855 

D 

0 

10 

20 

-0.35 

0.37 

0.67 

-0.42 

2 

12 

3G154 

* 

-1 

4887 

98 

1.18 

0.02 

0.00 

-0.11 

2 

12 

3G154 

A 

1 

77 

72 

2.64 

0.16 

1.06 

0.44 

2 

12 

3G154 

B 

0 

15 

14 

1.32 

0.30 

1.11 

-0.24 

2 

12 

3G154 

C 

0 

15 

14 

1.01 

0.32 

1.25 

-0.32 

2 

12 

3G154 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2 

13 

30853 

* 

-1 

4950 

99 

1.21 

0.02 

0.00 

0.05 

2 

13 

30853 

A 

1 

14 

32 

0.74 

0.23 

1.18 

0.19 

2 

13 

30853 

B 

0 

6 

14 

0.13 

0.41 

0.88 

-0.19 

2 

13 

30853 

C 

0 

12 

27 

0.74 

0.17 

1.31 

0.17 

2 

13 

30853 

D 

0 

12 

27 

0.21 

0.24 

0.92 

-0.23 

2 

14 

30370 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

2 

14 

30370 

A 

1 

48 

86 

1.07 

0.16 

0.75 

0.55 

2 

14 

30370 

B 

0 

1 

2 

-1.29 

0.00 

0.21 

-0.21 

2 

14 

30370 

C 

0 

2 

4 

-0.06 

0.54 

0.83 

-0.12 

2 

14 

30370 

D 

0 

5 

9 

-1.33 

0.70 

0.43 

-0.50 

2 

15 

30526 

* 

-1 

4942 

99 

1.21 

0.02 

0.00 

0.01 

2 

15 

30526 

A 

1 

45 

87 

1.19 

0.16 

1.01 

0.33 

2 

15 

30526 

B 

0 

2 

4 

0.11 

0.33 

0.59 

-0.18 

2 

15 

30526 

C 

0 

2 

4 

0.81 

0.22 

1.16 

-0.05 

2 

15 

30526 

D 

0 

3 

6 

-0.22 

0.44 

0.48 

-0.30 

2 

16 

30059 

* 

-1 

4926 

99 

1.21 

0.02 

0.00 

0.01 

2 

16 

30059 

A 

1 

57 

84 

1.19 

0.13 

1.04 

0.26 

2 

16 

30059 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

16 

30059 

C 

0 

10 

15 

0.55 

0.18 

0.90 

-0.23 

2 

16 

30059 

D 

0 

1 

1 

0.37 

0.00 

0.64 

-0.09 

2 

17 

30844 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.04 

2 

17 

30844 

A 

1 

42 

70 

0.99 

0.15 

1.09 

0.32 

2 

17 

30844 

B 

0 

4 

7 

0.38 

0.40 

0.95 

-0.10 

2 

17 

30844 

C 

0 

5 

8 

0.37 

0.20 

0.86 

-0.12 

2 

17 

30844 

D 

0 

9 

15 

0.18 

0.45 

1.34 

-0.25 

2 

18 

30825 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.02 

2 

18 

30825 

A 

1 

37 

66 

1.16 

0.16 

1.03 

0.27 

2 

18 

30825 

B 

0 

7 

13 

0.96 

0.33 

1.50 

-0.01 

2 

18 

30825 

C 

0 

7 

13 

0.34 

0.27 

0.73 

-0.26 

2 

18 

30825 

D 

0 

5 

9 

0.53 

0.20 

0.79 

-0.15 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2 

19 

30243 

* 

-1 

4943 

99 

1.21 

0.02 

0.00 

0.05 

2 

19 

30243 

A 

1 

18 

35 

1.27 

0.28 

1.04 

0.42 

2 

19 

30243 

B 

0 

10 

20 

0.62 

0.40 

1.80 

0.01 

2 

19 

30243 

C 

0 

8 

16 

0.45 

0.38 

1.33 

-0.06 

2 

19 

30243 

D 

0 

15 

29 

-0.12 

0.19 

0.54 

-0.40 

2 

20 

30695 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

2 

20 

30695 

A 

1 

7 

13 

0.82 

0.29 

1.51 

0.03 

2 

20 

30695 

B 

0 

3 

5 

1.20 

0.38 

1.39 

0.12 

2 

20 

30695 

C 

0 

15 

27 

1.02 

0.22 

1.51 

0.19 

2 

20 

30695 

D 

0 

31 

55 

0.55 

0.16 

0.96 

-0.25 

2 

21 

30023 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

2 

21 

30023 

A 

1 

47 

84 

0.99 

0.20 

1.09 

0.19 

2 

21 

30023 

B 

0 

5 

9 

0.42 

0.40 

1.40 

-0.11 

2 

21 

30023 

C 

0 

2 

4 

0.00 

0.59 

0.76 

-0.13 

2 

21 

30023 

D 

0 

2 

4 

0.37 

0.33 

0.98 

-0.07 

2 

22 

30936 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.05 

2 

22 

30936 

A 

1 

41 

77 

0.98 

0.13 

0.71 

0.66 

2 

22 

30936 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

22 

30936 

C 

0 

2 

4 

-0.97 

0.60 

0.33 

-0.28 

2 

22 

30936 

D 

0 

10 

19 

-0.69 

0.29 

0.52 

-0.57 

2 

23 

30160 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.03 

2 

23 

30160 

A 

1 

43 

74 

1.06 

0.17 

0.96 

0.42 

2 

23 

30160 

B 

0 

5 

9 

0.52 

0.55 

1.81 

-0.07 

2 

23 

30160 

C 

0 

4 

7 

-0.08 

0.25 

0.62 

-0.20 

2 

23 

30160 

D 

0 

6 

10 

-0.50 

0.35 

0.51 

-0.38 

2 

24 

30A113 

* 

-1 

4868 

97 

1.19 

0.02 

0.00 

-0.08 

2 

24 

30A113 

A 

1 

95 

75 

2.29 

0.12 

0.86 

0.55 

2 

24 

30A113 

B 

0 

14 

11 

0.79 

0.20 

0.60 

-0.31 

2 

24 

30A113 

C 

0 

17 

13 

0.63 

0.19 

0.53 

-0.40 

2 

24 

30A113 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2 

25 

30A816 

* 

-1 

4877 

98 

1.19 

0.02 

0.00 

-0.07 

2 

25 

30A816 

A 

1 

82 

70 

2.15 

0.13 

0.95 

0.44 

2 

25 

30A816 

B 

0 

16 

14 

0.75 

0.16 

0.54 

-0.37 

2 

25 

30A816 

C 

0 

19 

16 

1.28 

0.19 

1.08 

-0.20 

2 

25 

30A816 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

26 

30A613 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.08 

2 

26 

30A613 

A 

1 

71 

61 

2.32 

0.13 

1.01 

0.43 

2 

26 

30A613 

B 

0 

10 

9 

1.01 

0.27 

0.63 

-0.27 

2 

26 

30A613 

C 

0 

35 

30 

1.45 

0.12 

0.92 

-0.30 

2 

26 

30A613 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

27 

30173 

* 

-1 

4930 

99 

1.21 

0.02 

0.00 

0.03 

2 

27 

30173 

A 

1 

16 

25 

1.13 

0.24 

1.47 

0.16 

2 

27 

30173 

B 

0 

11 

17 

1.05 

0.33 

1.51 

0.09 

2 

27 

30173 

C 

0 

11 

17 

1.14 

0.36 

2.03 

0.13 

2 

27 

30173 

D 

0 

26 

41 

0.42 

0.20 

0.84 

-0.31 

2 

28 

3NBT130 

* 

-1 

4869 

97 

1.18 

0.02 

0.00 

-0.12 

2 

28 

3NBT130 

A 

1 

106 

85 

2.41 

0.10 

0.93 

0.44 

2 

28 

3NBT130 

B 

0 

13 

10 

1.24 

0.19 

0.67 

-0.29 

2 

28 

3NBT130 

C 

0 

6 

5 

0.66 

0.33 

0.39 

-0.31 

2 

28 

3NBT130 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

29 

3NBT214 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.12 

2 

29 

3NBT214 

A 

1 

85 

77 

2.57 

0.13 

1.05 

0.39 

2 

29 

3NBT214 

B 

0 

10 

9 

1.42 

0.39 

1.26 

-0.23 

2 

29 

3NBT214 

C 

0 

16 

14 

1.45 

0.17 

0.75 

-0.29 

2 

29 

3NBT214 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

30 

3NBT313 

* 

-1 

4871 

98 

1.18 

0.02 

0.00 

-0.12 

2 

30 

3NBT313 

A 

1 

88 

72 

2.51 

0.11 

0.95 

0.42 

2 

30 

3NBT313 

B 

0 

18 

15 

1.64 

0.31 

1.73 

-0.21 

2 

30 

3NBT313 

C 

0 

17 

14 

1.30 

0.18 

0.64 

-0.33 

2 

30 

3NBT313 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

easyCBM  CCSS  Third  Grade  Math  Measure  Development 


99 

Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3 

1 

3NF237 

* 

-1 

4759 

95 

1.16 

0.02 

0.00 

-0.14 

3 

1 

3NF237 

A 

1 

213 

91 

2.16 

0.08 

0.99 

0.28 

3 

1 

3NF237 

B 

0 

14 

6 

1.10 

0.18 

0.75 

-0.20 

3 

1 

3NF237 

C 

0 

8 

3 

0.90 

0.28 

0.67 

-0.18 

3 

1 

3NF237 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

2 

3NF245 

* 

-1 

4871 

98 

1.18 

0.02 

0.00 

-0.12 

3 

2 

3NF245 

A 

1 

94 

76 

2.43 

0.11 

1.03 

0.35 

3 

2 

3NF245 

B 

0 

12 

10 

1.21 

0.22 

0.62 

-0.29 

3 

2 

3NF245 

C 

0 

17 

14 

1.72 

0.27 

1.38 

-0.18 

3 

2 

3NF245 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

3 

3NF31 

* 

-1 

4887 

98 

1.20 

0.02 

0.00 

-0.04 

3 

3 

3NF31 

A 

1 

50 

47 

2.32 

0.16 

0.80 

0.61 

3 

3 

3NF31 

B 

0 

34 

32 

0.77 

0.13 

0.64 

-0.43 

3 

3 

3NF31 

C 

0 

23 

21 

0.96 

0.17 

0.78 

-0.25 

3 

3 

3NF31 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

4 

3MD73 

* 

-1 

4880 

98 

1.19 

0.02 

0.00 

-0.10 

3 

4 

3MD73 

A 

1 

100 

88 

2.16 

0.12 

1.07 

0.23 

3 

4 

3MD73 

B 

0 

7 

6 

1.43 

0.37 

1.34 

-0.13 

3 

4 

3MD73 

C 

0 

7 

6 

1.15 

0.37 

1.08 

-0.19 

3 

4 

3MD73 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

5 

3MD47 

* 

-1 

4884 

98 

1.20 

0.02 

0.00 

-0.04 

3 

5 

3MD47 

A 

1 

74 

67 

2.01 

0.13 

0.79 

0.55 

3 

5 

3MD47 

B 

0 

16 

15 

0.74 

0.20 

0.77 

-0.28 

3 

5 

3MD47 

C 

0 

20 

18 

0.51 

0.21 

0.79 

-0.41 

3 

5 

3MD47 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

6 

3MD48 

* 

-1 

4887 

98 

1.18 

0.02 

0.00 

-0.11 

3 

6 

3MD48 

A 

1 

65 

61 

2.79 

0.18 

1.10 

0.47 

3 

6 

3MD48 

B 

0 

18 

17 

1.22 

0.35 

1.64 

-0.30 

3 

6 

3MD48 

C 

0 

24 

22 

1.45 

0.21 

0.94 

-0.28 

3 

6 

3MD48 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

easyCBM  CCSS  Third  Grade  Math  Measure  Development 


100 

Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3 

7 

31027 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

3 

7 

31027 

A 

1 

51 

89 

1.04 

0.15 

0.90 

0.41 

3 

7 

31027 

B 

0 

2 

4 

-1.01 

0.60 

0.29 

-0.31 

3 

7 

31027 

C 

0 

2 

4 

0.25 

1.15 

1.51 

-0.10 

3 

7 

31027 

D 

0 

2 

4 

-0.88 

0.03 

0.28 

-0.28 

3 

8 

3G111 

* 

-1 

4881 

98 

1.18 

0.02 

0.00 

-0.10 

3 

8 

3G111 

A 

1 

106 

94 

2.20 

0.15 

1.04 

0.19 

3 

8 

3G111 

B 

0 

1 

1 

2.34 

0.00 

2.76 

0.01 

3 

8 

3G111 

C 

0 

6 

5 

0.73 

0.50 

1.04 

-0.21 

3 

8 

3G111 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

9 

30721 

* 

-1 

4945 

99 

1.21 

0.02 

0.00 

0.05 

3 

9 

30721 

A 

1 

37 

76 

0.80 

0.17 

1.15 

0.34 

3 

9 

30721 

B 

0 

4 

8 

0.36 

0.61 

1.58 

-0.07 

3 

9 

30721 

C 

0 

4 

8 

-0.37 

0.36 

0.58 

-0.27 

3 

9 

30721 

D 

0 

4 

8 

-0.06 

0.61 

1.00 

-0.19 

3 

10 

31046 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.03 

3 

10 

31046 

A 

1 

42 

72 

1.07 

0.14 

0.99 

0.43 

3 

10 

31046 

B 

0 

3 

5 

1.03 

0.41 

1.81 

0.05 

3 

10 

31046 

C 

0 

7 

12 

0.11 

0.21 

0.70 

-0.27 

3 

10 

31046 

D 

0 

6 

10 

-0.25 

0.24 

0.47 

-0.37 

3 

11 

30447 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

3 

11 

30447 

A 

1 

34 

60 

1.39 

0.18 

0.83 

0.58 

3 

11 

30447 

B 

0 

7 

12 

0.49 

0.15 

0.84 

-0.12 

3 

11 

30447 

C 

0 

7 

12 

-0.06 

0.27 

0.54 

-0.30 

3 

11 

30447 

D 

0 

9 

16 

-0.19 

0.25 

0.50 

-0.40 

3 

12 

31189 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.02 

3 

12 

31189 

A 

1 

31 

52 

1.39 

0.18 

1.13 

0.40 

3 

12 

31189 

B 

0 

11 

18 

0.85 

0.33 

1.44 

-0.07 

3 

12 

31189 

C 

0 

2 

3 

1.40 

0.34 

1.61 

0.07 

3 

12 

31189 

D 

0 

16 

27 

0.29 

0.15 

0.65 

-0.42 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3 

13 

3G143 

* 

-1 

4869 

97 

1.19 

0.02 

0.00 

-0.08 

3 

13 

3G143 

A 

1 

74 

59 

2.48 

0.13 

0.84 

0.55 

3 

13 

3G143 

B 

0 

22 

18 

1.13 

0.24 

0.94 

-0.29 

3 

13 

3G143 

C 

0 

29 

23 

1.03 

0.16 

0.68 

-0.39 

3 

13 

3G143 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

14 

30511 

* 

-1 

4947 

99 

1.21 

0.02 

0.00 

0.03 

3 

14 

30511 

A 

1 

41 

87 

1.06 

0.15 

0.91 

0.51 

3 

14 

30511 

B 

0 

2 

4 

-0.54 

0.35 

0.34 

-0.20 

3 

14 

30511 

C 

0 

1 

2 

-0.80 

0.00 

0.25 

-0.17 

3 

14 

30511 

D 

0 

3 

6 

-1.46 

2.15 

1.28 

-0.43 

3 

15 

30205 

* 

-1 

4930 

99 

1.21 

0.02 

0.00 

0.05 

3 

15 

30205 

A 

1 

52 

81 

0.86 

0.14 

0.96 

0.43 

3 

15 

30205 

B 

0 

9 

14 

-0.20 

0.25 

0.74 

-0.32 

3 

15 

30205 

C 

0 

1 

2 

-1.90 

0.00 

0.11 

-0.30 

3 

15 

30205 

D 

0 

2 

3 

-0.01 

0.88 

1.00 

-0.11 

3 

16 

30058 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.05 

3 

16 

30058 

A 

1 

43 

75 

0.68 

0.15 

1.15 

0.18 

3 

16 

30058 

B 

0 

1 

2 

-0.50 

0.00 

0.42 

-0.15 

3 

16 

30058 

C 

0 

1 

2 

-0.58 

0.00 

0.39 

-0.16 

3 

16 

30058 

D 

0 

12 

21 

0.40 

0.23 

1.45 

-0.09 

3 

17 

30978 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

3 

17 

30978 

A 

1 

39 

68 

1.23 

0.23 

0.91 

0.45 

3 

17 

30978 

B 

0 

11 

19 

0.29 

0.18 

0.98 

-0.18 

3 

17 

30978 

C 

0 

1 

2 

-1.67 

0.00 

0.12 

-0.23 

3 

17 

30978 

D 

0 

6 

11 

-0.65 

0.39 

0.43 

-0.35 

3 

18 

30249 

* 

-1 

4946 

99 

1.21 

0.02 

0.00 

0.03 

3 

18 

30249 

A 

1 

29 

60 

1.23 

0.17 

0.76 

0.60 

3 

18 

30249 

B 

0 

7 

15 

0.13 

0.27 

0.76 

-0.24 

3 

18 

30249 

C 

0 

3 

6 

0.36 

0.55 

1.00 

-0.09 

3 

18 

30249 

D 

0 

9 

19 

-0.29 

0.20 

0.47 

-0.48 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3 

19 

30848 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

3 

19 

30848 

A 

1 

21 

37 

1.40 

0.28 

0.94 

0.41 

3 

19 

30848 

B 

0 

8 

14 

0.51 

0.35 

1.07 

-0.12 

3 

19 

30848 

C 

0 

13 

23 

0.38 

0.18 

0.83 

-0.23 

3 

19 

30848 

D 

0 

15 

26 

0.57 

0.20 

1.08 

-0.14 

3 

20 

30696 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.02 

3 

20 

30696 

A 

1 

10 

19 

1.84 

0.52 

1.19 

0.38 

3 

20 

30696 

B 

0 

6 

11 

0.99 

0.34 

1.12 

0.00 

3 

20 

30696 

C 

0 

13 

24 

1.15 

0.27 

1.52 

0.08 

3 

20 

30696 

D 

0 

25 

46 

0.56 

0.14 

0.71 

-0.37 

3 

21 

30305 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.04 

3 

21 

30305 

A 

1 

48 

83 

0.92 

0.15 

0.99 

0.40 

3 

21 

30305 

B 

0 

4 

7 

0.14 

0.30 

0.89 

-0.15 

3 

21 

30305 

C 

0 

1 

2 

-0.20 

0.00 

0.55 

-0.11 

3 

21 

30305 

D 

0 

5 

9 

-0.47 

0.40 

0.55 

-0.35 

3 

22 

30336 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

3 

22 

30336 

A 

1 

45 

79 

1.33 

0.20 

0.79 

0.53 

3 

22 

30336 

B 

0 

4 

7 

-0.71 

0.42 

0.44 

-0.28 

3 

22 

30336 

C 

0 

1 

2 

-0.75 

0.00 

0.33 

-0.14 

3 

22 

30336 

D 

0 

7 

12 

-0.75 

0.64 

0.64 

-0.39 

3 

23 

30633 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

3 

23 

30633 

A 

1 

41 

73 

1.27 

0.22 

1.19 

0.47 

3 

23 

30633 

B 

0 

9 

16 

-0.38 

0.35 

0.92 

-0.38 

3 

23 

30633 

C 

0 

1 

2 

-0.27 

0.00 

0.49 

-0.11 

3 

23 

30633 

D 

0 

5 

9 

-0.04 

0.18 

0.65 

-0.19 

3 

24 

30003 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.03 

3 

24 

30003 

A 

1 

35 

58 

1.16 

0.15 

0.99 

0.38 

3 

24 

30003 

B 

0 

18 

30 

0.63 

0.19 

1.13 

-0.16 

3 

24 

30003 

C 

0 

4 

7 

-0.19 

0.17 

0.39 

-0.29 

3 

24 

30003 

D 

0 

3 

5 

0.06 

0.75 

0.87 

-0.19 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3 

25 

3OA410 

* 

-1 

4869 

97 

1.19 

0.02 

0.00 

-0.08 

3 

25 

3OA410 

A 

1 

89 

71 

2.30 

0.12 

0.97 

0.50 

3 

25 

3OA410 

B 

0 

22 

18 

1.08 

0.18 

0.84 

-0.30 

3 

25 

3OA410 

C 

0 

14 

11 

0.66 

0.22 

0.52 

-0.35 

3 

25 

3OA410 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

26 

30321 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.05 

3 

26 

30321 

A 

1 

20 

33 

1.20 

0.29 

1.08 

0.41 

3 

26 

30321 

B 

0 

10 

17 

0.32 

0.29 

1.01 

-0.10 

3 

26 

30321 

C 

0 

10 

17 

0.18 

0.36 

1.06 

-0.16 

3 

26 

30321 

D 

0 

20 

33 

0.28 

0.14 

0.84 

-0.19 

3 

27 

30469 

* 

-1 

4946 

99 

1.21 

0.02 

0.00 

0.02 

3 

27 

30469 

A 

1 

13 

27 

1.99 

0.33 

0.81 

0.58 

3 

27 

30469 

B 

0 

11 

23 

0.47 

0.27 

0.72 

-0.19 

3 

27 

30469 

C 

0 

7 

15 

0.76 

0.35 

0.99 

-0.04 

3 

27 

30469 

D 

0 

17 

35 

0.35 

0.21 

0.62 

-0.34 

3 

28 

3NBT33 

* 

-1 

4888 

98 

1.20 

0.02 

0.00 

-0.04 

3 

28 

3NBT33 

A 

1 

80 

75 

1.93 

0.12 

0.90 

0.47 

3 

28 

3NBT33 

B 

0 

12 

11 

0.63 

0.30 

0.76 

-0.30 

3 

28 

3NBT33 

C 

0 

14 

13 

0.64 

0.17 

0.63 

-0.32 

3 

28 

3NBT33 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

29 

3NBT317 

* 

-1 

4885 

98 

1.18 

0.02 

0.00 

-0.11 

3 

29 

3NBT317 

A 

1 

83 

76 

2.43 

0.12 

1.01 

0.40 

3 

29 

3NBT317 

B 

0 

16 

15 

1.32 

0.17 

0.70 

-0.31 

3 

29 

3NBT317 

C 

0 

10 

9 

1.42 

0.27 

0.86 

-0.21 

3 

29 

3NBT317 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

30 

3NBT232 

* 

-1 

4873 

98 

1.19 

0.02 

0.00 

-0.09 

3 

30 

3NBT232 

A 

1 

81 

67 

2.41 

0.13 

0.91 

0.51 

3 

30 

3NBT232 

B 

0 

29 

24 

1.11 

0.11 

0.65 

-0.40 

3 

30 

3NBT232 

C 

0 

11 

9 

1.02 

0.23 

0.65 

-0.25 

3 

30 

3NBT232 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4 

1 

3NF27 

* 

-1 

4887 

98 

1.18 

0.02 

0.00 

-0.11 

4 

1 

3NF27 

A 

1 

98 

92 

2.41 

0.14 

0.89 

0.40 

4 

1 

3NF27 

B 

0 

3 

3 

-0.70 

0.12 

0.13 

-0.33 

4 

1 

3NF27 

C 

0 

6 

6 

0.67 

0.34 

0.69 

-0.25 

4 

1 

3NF27 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

2 

3NF256 

* 

-1 

4880 

98 

1.19 

0.02 

0.00 

-0.10 

4 

2 

3NF256 

A 

1 

85 

75 

2.37 

0.13 

0.96 

0.44 

4 

2 

3NF256 

B 

0 

11 

10 

1.23 

0.26 

0.86 

-0.22 

4 

2 

3NF256 

C 

0 

18 

16 

1.07 

0.20 

0.74 

-0.35 

4 

2 

3NF256 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

3 

3NF277 

* 

-1 

4888 

98 

1.17 

0.02 

0.00 

-0.17 

4 

3 

3NF277 

A 

1 

74 

70 

3.02 

0.14 

1.07 

0.37 

4 

3 

3NF277 

B 

0 

8 

8 

1.58 

0.45 

0.83 

-0.26 

4 

3 

3NF277 

C 

0 

24 

23 

2.14 

0.23 

1.48 

-0.24 

4 

3 

3NF277 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

4 

3MD110 

* 

-1 

4884 

98 

1.18 

0.02 

0.00 

-0.11 

4 

4 

3MD110 

A 

1 

95 

86 

2.45 

0.14 

0.91 

0.43 

4 

4 

3MD110 

B 

0 

11 

10 

0.57 

0.25 

0.55 

-0.36 

4 

4 

3MD110 

C 

0 

4 

4 

0.50 

0.78 

0.85 

-0.22 

4 

4 

3MD110 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

5 

3MD31 

* 

-1 

4885 

98 

1.17 

0.02 

0.00 

-0.16 

4 

5 

3MD31 

A 

1 

91 

83 

2.92 

0.12 

0.94 

0.43 

4 

5 

3MD31 

B 

0 

11 

10 

1.69 

0.30 

0.87 

-0.26 

4 

5 

3MD31 

C 

0 

7 

6 

1.14 

0.22 

0.38 

-0.32 

4 

5 

3MD31 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

6 

3MD210 

* 

-1 

4875 

98 

1.19 

0.02 

0.00 

-0.08 

4 

6 

3MD210 

A 

1 

65 

55 

2.39 

0.14 

0.93 

0.48 

4 

6 

3MD210 

B 

0 

31 

26 

1.15 

0.12 

0.64 

-0.42 

4 

6 

3MD210 

C 

0 

23 

19 

1.61 

0.16 

1.04 

-0.14 

4 

6 

3MD210 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

easyCBM  CCSS  Third  Grade  Math  Measure  Development 


105 

Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4 

7 

30556 

* 

-1 

4949 

99 

1.21 

0.02 

0.00 

0.04 

4 

7 

30556 

A 

1 

39 

87 

0.91 

0.19 

1.04 

0.43 

4 

7 

30556 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

7 

30556 

C 

0 

3 

7 

-0.25 

0.63 

0.73 

-0.16 

4 

7 

30556 

D 

0 

3 

7 

-1.75 

2.07 

0.96 

-0.43 

4 

8 

31006 

* 

-1 

4956 

99 

1.21 

0.02 

0.00 

0.03 

4 

8 

31006 

A 

1 

32 

84 

1.13 

0.17 

0.89 

0.54 

4 

8 

31006 

B 

0 

1 

3 

-0.97 

0.00 

0.21 

-0.19 

4 

8 

31006 

C 

0 

4 

11 

0.07 

0.39 

0.69 

-0.16 

4 

8 

31006 

D 

0 

1 

3 

-5.89 

0.00 

0.00 

-0.73 

4 

9 

3G27 

* 

-1 

4886 

98 

1.19 

0.02 

0.00 

-0.07 

4 

9 

3G27 

A 

1 

97 

90 

1.90 

0.10 

0.97 

0.27 

4 

9 

3G27 

B 

0 

2 

2 

-0.01 

1.04 

0.39 

-0.24 

4 

9 

3G27 

C 

0 

9 

8 

1.17 

0.39 

1.37 

-0.18 

4 

9 

3G27 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

10 

30142 

* 

-1 

4928 

99 

1.21 

0.02 

0.00 

0.04 

4 

10 

30142 

A 

1 

47 

71 

1.12 

0.12 

0.79 

0.50 

4 

10 

30142 

B 

0 

7 

11 

0.83 

0.43 

2.10 

0.02 

4 

10 

30142 

C 

0 

5 

8 

0.29 

0.18 

0.81 

-0.11 

4 

10 

30142 

D 

0 

7 

11 

-1.52 

0.46 

0.19 

-0.66 

4 

11 

30860 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.04 

4 

11 

30860 

A 

1 

35 

58 

0.78 

0.16 

1.40 

0.04 

4 

11 

30860 

B 

0 

2 

3 

1.00 

0.30 

1.43 

0.05 

4 

11 

30860 

C 

0 

15 

25 

1.03 

0.21 

1.82 

0.18 

4 

11 

30860 

D 

0 

8 

13 

0.03 

0.25 

0.64 

-0.31 

4 

12 

3G132 

* 

-1 

4888 

98 

1.20 

0.02 

0.00 

-0.04 

4 

12 

3G132 

A 

1 

67 

63 

1.96 

0.15 

1.14 

0.39 

4 

12 

3G132 

B 

0 

16 

15 

1.23 

0.19 

1.04 

-0.14 

4 

12 

3G132 

C 

0 

23 

22 

0.86 

0.19 

0.82 

-0.33 

4 

12 

3G132 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4 

13 

3G149 

* 

-1 

4884 

98 

1.18 

0.02 

0.00 

-0.11 

4 

13 

3G149 

A 

1 

71 

65 

2.36 

0.14 

1.20 

0.23 

4 

13 

3G149 

B 

0 

22 

20 

2.01 

0.22 

1.54 

-0.07 

4 

13 

3G149 

C 

0 

17 

15 

1.60 

0.19 

0.88 

-0.22 

4 

13 

3G149 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

14 

30517 

* 

-1 

4948 

99 

1.21 

0.02 

0.00 

0.04 

4 

14 

30517 

A 

1 

39 

85 

0.84 

0.16 

0.85 

0.47 

4 

14 

30517 

B 

0 

1 

2 

-0.75 

0.00 

0.38 

-0.16 

4 

14 

30517 

C 

0 

2 

4 

-0.39 

1.01 

0.85 

-0.17 

4 

14 

30517 

D 

0 

4 

9 

-0.97 

1.05 

0.70 

-0.39 

4 

15 

30090 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.05 

4 

15 

30090 

A 

1 

46 

81 

0.99 

0.14 

0.70 

0.59 

4 

15 

30090 

B 

0 

3 

5 

-0.06 

0.50 

0.92 

-0.13 

4 

15 

30090 

C 

0 

1 

2 

0.51 

0.00 

1.25 

-0.01 

4 

15 

30090 

D 

0 

7 

12 

-1.44 

0.47 

0.27 

-0.62 

4 

16 

30207 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.02 

4 

16 

30207 

A 

1 

43 

81 

1.20 

0.16 

1.08 

0.43 

4 

16 

30207 

B 

0 

3 

6 

0.47 

0.69 

1.27 

-0.11 

4 

16 

30207 

C 

0 

4 

8 

-0.34 

0.33 

0.45 

-0.33 

4 

16 

30207 

D 

0 

3 

6 

-0.10 

0.26 

0.52 

-0.24 

4 

17 

30660 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

4 

17 

30660 

A 

1 

39 

70 

0.96 

0.12 

0.84 

0.45 

4 

17 

30660 

B 

0 

9 

16 

0.35 

0.39 

1.47 

-0.15 

4 

17 

30660 

C 

0 

4 

7 

-0.12 

0.53 

0.76 

-0.23 

4 

17 

30660 

D 

0 

4 

7 

-0.58 

0.27 

0.37 

-0.37 

4 

18 

30698 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.05 

4 

18 

30698 

A 

1 

31 

57 

0.83 

0.21 

1.35 

0.31 

4 

18 

30698 

B 

0 

6 

11 

0.31 

0.24 

1.01 

-0.08 

4 

18 

30698 

C 

0 

8 

15 

-0.09 

0.44 

0.87 

-0.25 

4 

18 

30698 

D 

0 

9 

17 

0.27 

0.23 

1.03 

-0.11 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4 

19 

30843 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.01 

4 

19 

30843 

A 

1 

26 

46 

1.75 

0.24 

0.81 

0.52 

4 

19 

30843 

B 

0 

18 

32 

0.69 

0.21 

0.98 

-0.21 

4 

19 

30843 

C 

0 

3 

5 

-0.59 

0.27 

0.22 

-0.32 

4 

19 

30843 

D 

0 

9 

16 

0.37 

0.33 

0.94 

-0.24 

4 

20 

30395 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.05 

4 

20 

30395 

A 

1 

8 

14 

1.78 

0.61 

0.96 

0.40 

4 

20 

30395 

B 

0 

16 

29 

0.78 

0.20 

1.29 

0.11 

4 

20 

30395 

C 

0 

11 

20 

0.59 

0.24 

1.09 

0.01 

4 

20 

30395 

D 

0 

21 

38 

-0.07 

0.24 

0.63 

-0.41 

4 

21 

30631 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

4 

21 

30631 

A 

1 

47 

82 

0.97 

0.17 

1.24 

0.40 

4 

21 

30631 

B 

0 

3 

5 

0.02 

0.86 

1.45 

-0.14 

4 

21 

30631 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

21 

30631 

D 

0 

7 

12 

-0.50 

0.42 

0.63 

-0.37 

4 

22 

30159 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.06 

4 

22 

30159 

A 

1 

44 

76 

0.70 

0.15 

0.95 

0.38 

4 

22 

30159 

B 

0 

5 

9 

-0.11 

0.31 

0.83 

-0.18 

4 

22 

30159 

C 

0 

6 

10 

-0.19 

0.23 

0.72 

-0.23 

4 

22 

30159 

D 

0 

3 

5 

-0.33 

0.43 

0.65 

-0.19 

4 

23 

30A112 

* 

-1 

4874 

98 

1.18 

0.02 

0.00 

-0.10 

4 

23 

30A112 

A 

1 

107 

89 

2.19 

0.12 

0.97 

0.31 

4 

23 

30A112 

B 

0 

3 

3 

0.65 

0.59 

0.54 

-0.18 

4 

23 

30A112 

C 

0 

10 

8 

1.03 

0.31 

0.88 

-0.25 

4 

23 

30A112 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

24 

30199 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.04 

4 

24 

30199 

A 

1 

31 

56 

0.91 

0.14 

1.15 

0.27 

4 

24 

30199 

B 

0 

2 

4 

0.79 

0.33 

1.15 

0.02 

4 

24 

30199 

C 

0 

10 

18 

0.72 

0.30 

1.44 

0.00 

4 

24 

30199 

D 

0 

12 

22 

0.22 

0.18 

0.75 

-0.33 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4 

25 

30035 

* 

-1 

4946 

99 

1.21 

0.02 

0.00 

0.03 

4 

25 

30035 

A 

1 

25 

52 

1.21 

0.18 

1.00 

0.43 

4 

25 

30035 

B 

0 

8 

17 

0.50 

0.29 

1.04 

-0.13 

4 

25 

30035 

C 

0 

3 

6 

0.66 

0.63 

1.23 

-0.03 

4 

25 

30035 

D 

0 

12 

25 

0.15 

0.30 

0.80 

-0.37 

4 

26 

30465 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

4 

26 

30465 

A 

1 

21 

37 

1.32 

0.19 

0.88 

0.47 

4 

26 

30465 

B 

0 

5 

9 

0.29 

0.23 

0.64 

-0.14 

4 

26 

30465 

C 

0 

17 

30 

0.74 

0.19 

1.22 

0.00 

4 

26 

30465 

D 

0 

14 

25 

0.01 

0.24 

0.65 

-0.44 

4 

27 

30775 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

4 

27 

30775 

A 

1 

14 

25 

1.12 

0.27 

1.47 

0.17 

4 

27 

30775 

B 

0 

5 

9 

0.39 

0.42 

0.74 

-0.13 

4 

27 

30775 

C 

0 

8 

14 

1.38 

0.19 

1.59 

0.23 

4 

27 

30775 

D 

0 

29 

52 

0.58 

0.21 

1.45 

-0.24 

4 

28 

3NBT322 

* 

-1 

4887 

98 

1.20 

0.02 

0.00 

-0.04 

4 

28 

3NBT322 

A 

1 

79 

74 

1.90 

0.13 

0.87 

0.51 

4 

28 

3NBT322 

B 

0 

22 

21 

0.42 

0.16 

0.58 

-0.47 

4 

28 

3NBT322 

C 

0 

6 

6 

0.78 

0.19 

0.71 

-0.15 

4 

28 

3NBT322 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

29 

3NBT230 

* 

-1 

4888 

98 

1.17 

0.02 

0.00 

-0.17 

4 

29 

3NBT230 

A 

1 

87 

82 

2.94 

0.13 

0.95 

0.39 

4 

29 

3NBT230 

B 

0 

11 

10 

1.68 

0.29 

0.84 

-0.28 

4 

29 

3NBT230 

C 

0 

8 

8 

1.61 

0.42 

0.86 

-0.25 

4 

29 

3NBT230 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

30 

3NBT114 

* 

-1 

4865 

97 

1.19 

0.02 

0.00 

-0.09 

4 

30 

3NBT114 

A 

1 

83 

64 

2.32 

0.13 

1.08 

0.44 

4 

30 

3NBT114 

B 

0 

32 

25 

1.23 

0.18 

0.99 

-0.32 

4 

30 

3NBT114 

C 

0 

14 

11 

1.05 

0.25 

0.78 

-0.24 

4 

30 

3NBT114 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

5 

1 

3NF22 

* 

-1 

4756 

95 

1.16 

0.02 

0.00 

-0.14 

5 

1 

3NF22 

A 

1 

219 

92 

2.19 

0.08 

0.89 

0.38 

5 

1 

3NF22 

B 

0 

5 

2 

0.35 

0.37 

0.42 

-0.20 

5 

1 

3NF22 

C 

0 

14 

6 

0.50 

0.21 

0.49 

-0.32 

5 

1 

3NF22 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

2 

3NF235 

* 

-1 

4873 

98 

1.19 

0.02 

0.00 

-0.09 

5 

2 

3NF235 

A 

1 

88 

73 

2.14 

0.13 

1.11 

0.22 

5 

2 

3NF235 

B 

0 

23 

19 

1.46 

0.23 

1.66 

-0.20 

5 

2 

3NF235 

C 

0 

10 

8 

1.71 

0.30 

1.53 

-0.06 

5 

2 

3NF235 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

3 

3NF267 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.08 

5 

3 

3NF267 

A 

1 

72 

62 

2.36 

0.13 

0.99 

0.50 

5 

3 

3NF267 

B 

0 

29 

25 

1.21 

0.10 

0.65 

-0.39 

5 

3 

3NF267 

C 

0 

15 

13 

1.34 

0.17 

0.80 

-0.21 

5 

3 

3NF267 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

4 

3MD54 

* 

-1 

4888 

98 

1.20 

0.02 

0.00 

-0.04 

5 

4 

3MD54 

A 

1 

85 

80 

1.87 

0.12 

0.87 

0.44 

5 

4 

3MD54 

B 

0 

9 

8 

0.36 

0.18 

0.46 

-0.32 

5 

4 

3MD54 

C 

0 

12 

11 

0.74 

0.39 

1.46 

-0.26 

5 

4 

3MD54 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

5 

3MD111 

* 

-1 

4876 

98 

1.19 

0.02 

0.00 

-0.10 

5 

5 

3MD111 

A 

1 

88 

75 

2.38 

0.12 

0.92 

0.49 

5 

5 

3MD111 

B 

0 

14 

12 

1.15 

0.24 

0.84 

-0.27 

5 

5 

3MD111 

C 

0 

16 

14 

0.91 

0.17 

0.56 

-0.37 

5 

5 

3MD111 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

6 

3MD46 

* 

-1 

4887 

98 

1.19 

0.02 

0.00 

-0.07 

5 

6 

3MD46 

A 

1 

56 

52 

2.15 

0.12 

0.99 

0.35 

5 

6 

3MD46 

B 

0 

27 

25 

1.42 

0.21 

1.24 

-0.21 

5 

6 

3MD46 

C 

0 

24 

22 

1.43 

0.23 

1.15 

-0.19 

5 

6 

3MD46 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

5 

7 

31002 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.05 

5 

7 

31002 

A 

1 

48 

87 

0.77 

0.14 

0.93 

0.45 

5 

7 

31002 

B 

0 

2 

4 

-0.22 

0.06 

0.67 

-0.14 

5 

7 

31002 

C 

0 

2 

4 

-0.28 

0.52 

0.72 

-0.15 

5 

7 

31002 

D 

0 

3 

5 

-1.33 

0.80 

0.35 

-0.42 

5 

8 

3G213 

* 

-1 

4873 

98 

1.18 

0.02 

0.00 

-0.10 

5 

8 

3G213 

A 

1 

114 

94 

2.14 

0.11 

0.92 

0.29 

5 

8 

3G213 

B 

0 

3 

2 

0.71 

1.09 

1.45 

-0.17 

5 

8 

3G213 

C 

0 

4 

3 

0.52 

0.48 

0.54 

-0.23 

5 

8 

3G213 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

9 

30890 

* 

-1 

4955 

99 

1.21 

0.02 

0.00 

0.03 

5 

9 

30890 

A 

1 

31 

79 

0.92 

0.12 

0.87 

0.38 

5 

9 

30890 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

9 

30890 

C 

0 

8 

21 

0.13 

0.43 

1.23 

-0.38 

5 

9 

30890 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

10 

30444 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.02 

5 

10 

30444 

A 

1 

42 

74 

1.32 

0.14 

0.74 

0.62 

5 

10 

30444 

B 

0 

10 

18 

-0.13 

0.26 

0.58 

-0.47 

5 

10 

30444 

C 

0 

3 

5 

-0.42 

0.15 

0.33 

-0.31 

5 

10 

30444 

D 

0 

2 

4 

0.12 

0.51 

0.63 

-0.15 

5 

11 

30576 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.03 

5 

11 

30576 

A 

1 

35 

59 

1.33 

0.15 

0.81 

0.51 

5 

11 

30576 

B 

0 

8 

14 

0.63 

0.29 

1.21 

-0.07 

5 

11 

30576 

C 

0 

6 

10 

0.47 

0.43 

1.08 

-0.10 

5 

11 

30576 

D 

0 

10 

17 

-0.58 

0.42 

0.49 

-0.53 

5 

12 

31194 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

5 

12 

31194 

A 

1 

26 

46 

1.39 

0.20 

0.92 

0.47 

5 

12 

31194 

B 

0 

7 

13 

-0.62 

0.41 

0.38 

-0.45 

5 

12 

31194 

C 

0 

8 

14 

0.91 

0.48 

3.06 

0.04 

5 

12 

31194 

D 

0 

15 

27 

0.34 

0.17 

0.78 

-0.23 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

5 

13 

3G134 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.11 

5 

13 

3G134 

A 

1 

71 

64 

2.37 

0.14 

1.17 

0.25 

5 

13 

3G134 

B 

0 

21 

19 

1.77 

0.24 

1.37 

-0.17 

5 

13 

3G134 

C 

0 

19 

17 

1.81 

0.16 

1.05 

-0.14 

5 

13 

3G134 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

14 

30362 

* 

-1 

4927 

99 

1.21 

0.02 

0.00 

0.02 

5 

14 

30362 

A 

1 

59 

88 

1.12 

0.13 

0.91 

0.41 

5 

14 

30362 

B 

0 

4 

6 

0.37 

0.43 

1.11 

-0.13 

5 

14 

30362 

C 

0 

2 

3 

-0.65 

0.35 

0.33 

-0.25 

5 

14 

30362 

D 

0 

2 

3 

-1.25 

0.86 

0.23 

-0.35 

5 

15 

30519 

* 

-1 

4951 

99 

1.21 

0.02 

0.00 

0.03 

5 

15 

30519 

A 

1 

36 

84 

0.91 

0.15 

1.04 

0.30 

5 

15 

30519 

B 

0 

3 

7 

0.04 

0.25 

0.62 

-0.25 

5 

15 

30519 

C 

0 

2 

5 

0.59 

0.46 

1.14 

-0.05 

5 

15 

30519 

D 

0 

2 

5 

0.13 

0.24 

0.66 

-0.17 

5 

16 

30837 

* 

-1 

4933 

99 

1.21 

0.02 

0.00 

0.04 

5 

16 

30837 

A 

1 

47 

77 

0.92 

0.14 

0.88 

0.39 

5 

16 

30837 

B 

0 

4 

7 

-0.63 

0.87 

1.06 

-0.32 

5 

16 

30837 

C 

0 

7 

11 

0.37 

0.36 

1.36 

-0.10 

5 

16 

30837 

D 

0 

3 

5 

-0.45 

0.55 

0.57 

-0.24 

5 

17 

30250 

* 

-1 

4945 

99 

1.21 

0.02 

0.00 

0.04 

5 

17 

30250 

A 

1 

34 

69 

1.06 

0.15 

0.79 

0.52 

5 

17 

30250 

B 

0 

2 

4 

-0.17 

0.08 

0.51 

-0.17 

5 

17 

30250 

C 

0 

3 

6 

0.11 

0.49 

0.85 

-0.14 

5 

17 

30250 

D 

0 

10 

20 

-0.18 

0.36 

1.00 

-0.42 

5 

18 

30683 

* 

-1 

4697 

94 

1.16 

0.02 

0.00 

-0.14 

5 

18 

30683 

A 

1 

232 

78 

2.34 

0.08 

0.84 

0.56 

5 

18 

30683 

B 

0 

23 

8 

0.63 

0.18 

0.55 

-0.28 

5 

18 

30683 

C 

0 

31 

10 

0.67 

0.16 

0.60 

-0.32 

5 

18 

30683 

D 

0 

11 

4 

-0.12 

0.34 

0.29 

-0.30 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

5 

19 

30846 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.04 

5 

19 

30846 

A 

1 

21 

36 

1.68 

0.29 

0.80 

0.59 

5 

19 

30846 

B 

0 

15 

25 

0.34 

0.20 

0.84 

-0.19 

5 

19 

30846 

C 

0 

7 

12 

0.06 

0.28 

0.63 

-0.21 

5 

19 

30846 

D 

0 

16 

27 

0.15 

0.16 

0.64 

-0.30 

5 

20 

30221 

* 

-1 

4946 

99 

1.21 

0.02 

0.00 

0.02 

5 

20 

30221 

A 

1 

8 

17 

1.94 

0.56 

1.15 

0.35 

5 

20 

30221 

B 

0 

25 

52 

1.09 

0.19 

1.22 

0.08 

5 

20 

30221 

C 

0 

6 

13 

0.55 

0.58 

0.79 

-0.14 

5 

20 

30221 

D 

0 

9 

19 

0.17 

0.32 

0.50 

-0.32 

5 

21 

30196 

* 

-1 

4933 

99 

1.21 

0.02 

0.00 

0.04 

5 

21 

30196 

A 

1 

50 

82 

0.93 

0.16 

1.06 

0.46 

5 

21 

30196 

B 

0 

2 

3 

-0.14 

0.09 

0.66 

-0.12 

5 

21 

30196 

C 

0 

2 

3 

-1.89 

0.01 

0.11 

-0.40 

5 

21 

30196 

D 

0 

7 

11 

-0.20 

0.30 

0.79 

-0.26 

5 

22 

30158 

* 

-1 

4933 

99 

1.21 

0.02 

0.00 

0.04 

5 

22 

30158 

A 

1 

48 

79 

0.84 

0.12 

0.96 

0.35 

5 

22 

30158 

B 

0 

4 

7 

0.16 

0.09 

0.75 

-0.15 

5 

22 

30158 

C 

0 

6 

10 

0.23 

0.62 

1.98 

-0.16 

5 

22 

30158 

D 

0 

3 

5 

-0.39 

0.30 

0.46 

-0.27 

5 

23 

31068 

* 

-1 

4925 

99 

1.21 

0.02 

0.00 

0.01 

5 

23 

31068 

A 

1 

55 

80 

1.36 

0.14 

0.88 

0.39 

5 

23 

31068 

B 

0 

4 

6 

1.59 

0.36 

2.63 

0.10 

5 

23 

31068 

C 

0 

2 

3 

-0.52 

0.18 

0.27 

-0.26 

5 

23 

31068 

D 

0 

8 

12 

-0.15 

0.28 

0.50 

-0.43 

5 

24 

30479 

* 

-1 

4945 

99 

1.21 

0.02 

0.00 

0.03 

5 

24 

30479 

A 

1 

27 

55 

1.47 

0.23 

0.83 

0.60 

5 

24 

30479 

B 

0 

2 

4 

-0.09 

0.67 

0.59 

-0.13 

5 

24 

30479 

C 

0 

8 

16 

0.18 

0.43 

1.10 

-0.19 

5 

24 

30479 

D 

0 

12 

24 

-0.34 

0.20 

0.47 

-0.47 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

5 

25 

31083 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.02 

5 

25 

31083 

A 

1 

31 

54 

1.10 

0.16 

1.41 

0.23 

5 

25 

31083 

B 

0 

25 

44 

0.69 

0.19 

1.32 

-0.19 

5 

25 

31083 

C 

0 

1 

2 

-0.37 

0.00 

0.29 

-0.18 

5 

25 

31083 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

26 

30783 

* 

-1 

4947 

99 

1.21 

0.02 

0.00 

0.05 

5 

26 

30783 

A 

1 

16 

34 

1.34 

0.46 

1.46 

0.37 

5 

26 

30783 

B 

0 

6 

13 

0.99 

0.46 

2.17 

0.11 

5 

26 

30783 

C 

0 

10 

21 

0.23 

0.24 

0.82 

-0.12 

5 

26 

30783 

D 

0 

15 

32 

-0.19 

0.32 

0.62 

-0.35 

5 

27 

30331 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

5 

27 

30331 

A 

1 

13 

23 

1.06 

0.27 

1.42 

0.16 

5 

27 

30331 

B 

0 

3 

5 

1.07 

0.39 

1.23 

0.07 

5 

27 

30331 

C 

0 

12 

21 

1.15 

0.19 

1.37 

0.19 

5 

27 

30331 

D 

0 

29 

51 

0.44 

0.22 

0.87 

-0.32 

5 

28 

3NBT328 

* 

-1 

4872 

98 

1.18 

0.02 

0.00 

-0.12 

5 

28 

3NBT328 

A 

1 

103 

84 

2.43 

0.10 

0.89 

0.46 

5 

28 

3NBT328 

B 

0 

4 

3 

1.54 

0.52 

0.99 

-0.11 

5 

28 

3NBT328 

C 

0 

15 

12 

0.87 

0.18 

0.46 

-0.45 

5 

28 

3NBT328 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

29 

3NBT324 

* 

-1 

4880 

98 

1.19 

0.02 

0.00 

-0.10 

5 

29 

3NBT324 

A 

1 

84 

74 

2.44 

0.12 

0.82 

0.53 

5 

29 

3NBT324 

B 

0 

21 

18 

0.86 

0.16 

0.55 

-0.47 

5 

29 

3NBT324 

C 

0 

9 

8 

1.24 

0.32 

0.88 

-0.20 

5 

29 

3NBT324 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

30 

3NBT127 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.10 

5 

30 

3NBT127 

A 

1 

77 

66 

2.35 

0.14 

1.14 

0.35 

5 

30 

3NBT127 

B 

0 

4 

3 

1.28 

0.39 

0.71 

-0.12 

5 

30 

3NBT127 

C 

0 

35 

30 

1.45 

0.16 

1.17 

-0.32 

5 

30 

3NBT127 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

6 

1 

3NF214 

* 

-1 

4877 

98 

1.19 

0.02 

0.00 

-0.07 

6 

1 

3NF214 

A 

1 

106 

91 

1.91 

0.11 

1.00 

0.23 

6 

1 

3NF214 

B 

0 

4 

3 

0.66 

0.25 

0.54 

-0.19 

6 

1 

3NF214 

C 

0 

7 

6 

1.16 

0.44 

1.66 

-0.14 

6 

1 

3NF214 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

2 

3NF278 

* 

-1 

4885 

98 

1.18 

0.02 

0.00 

-0.11 

6 

2 

3NF278 

A 

1 

83 

76 

2.51 

0.11 

0.82 

0.53 

6 

2 

3NF278 

B 

0 

8 

7 

1.32 

0.26 

0.76 

-0.21 

6 

2 

3NF278 

C 

0 

18 

17 

1.01 

0.17 

0.52 

-0.46 

6 

2 

3NF278 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

3 

3NF242 

* 

-1 

4874 

98 

1.18 

0.02 

0.00 

-0.10 

6 

3 

3NF242 

A 

1 

69 

58 

2.53 

0.16 

1.11 

0.45 

6 

3 

3NF242 

B 

0 

18 

15 

1.35 

0.20 

0.80 

-0.24 

6 

3 

3NF242 

C 

0 

33 

28 

1.42 

0.14 

0.82 

-0.31 

6 

3 

3NF242 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

4 

3MD64 

* 

-1 

4870 

98 

1.19 

0.02 

0.00 

-0.08 

6 

4 

3MD64 

A 

1 

102 

82 

2.10 

0.12 

1.04 

0.35 

6 

4 

3MD64 

B 

0 

18 

15 

0.94 

0.24 

1.00 

-0.31 

6 

4 

3MD64 

C 

0 

4 

3 

1.06 

0.30 

0.77 

-0.12 

6 

4 

3MD64 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

5 

3MD44 

* 

-1 

4879 

98 

1.18 

0.02 

0.00 

-0.11 

6 

5 

3MD44 

A 

1 

85 

74 

2.50 

0.14 

1.02 

0.46 

6 

5 

3MD44 

B 

0 

13 

11 

1.11 

0.25 

0.76 

-0.27 

6 

5 

3MD44 

C 

0 

17 

15 

1.07 

0.20 

0.67 

-0.33 

6 

5 

3MD44 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

6 

3MD35 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.10 

6 

6 

3MD35 

A 

1 

65 

56 

2.68 

0.14 

0.80 

0.60 

6 

6 

3MD35 

B 

0 

23 

20 

1.54 

0.16 

1.00 

-0.20 

6 

6 

3MD35 

C 

0 

28 

24 

0.96 

0.15 

0.52 

-0.50 

6 

6 

3MD35 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

6 

7 

30404 

* 

-1 

4950 

99 

1.21 

0.02 

0.00 

0.02 

6 

7 

30404 

A 

1 

40 

91 

0.98 

0.15 

1.10 

0.18 

6 

7 

30404 

B 

0 

2 

5 

0.00 

0.84 

0.81 

-0.21 

6 

7 

30404 

C 

0 

2 

5 

0.75 

1.20 

2.24 

-0.04 

6 

7 

30404 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

8 

30854 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.05 

6 

8 

30854 

A 

1 

49 

83 

0.77 

0.13 

0.98 

0.35 

6 

8 

30854 

B 

0 

3 

5 

0.71 

0.33 

1.60 

0.02 

6 

8 

30854 

C 

0 

4 

7 

-0.18 

0.33 

0.69 

-0.23 

6 

8 

30854 

D 

0 

3 

5 

-0.81 

0.27 

0.34 

-0.36 

6 

9 

30748 

* 

-1 

4943 

99 

1.21 

0.02 

0.00 

0.03 

6 

9 

30748 

A 

1 

41 

80 

0.83 

0.13 

1.12 

0.08 

6 

9 

30748 

B 

0 

3 

6 

0.98 

0.67 

2.04 

0.06 

6 

9 

30748 

C 

0 

6 

12 

0.56 

0.26 

1.13 

-0.11 

6 

9 

30748 

D 

0 

1 

2 

0.35 

0.00 

0.76 

-0.08 

6 

10 

30440 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.05 

6 

10 

30440 

A 

1 

39 

68 

0.97 

0.15 

0.86 

0.53 

6 

10 

30440 

B 

0 

4 

7 

-0.50 

0.22 

0.42 

-0.31 

6 

10 

30440 

C 

0 

3 

5 

0.47 

0.43 

1.26 

-0.03 

6 

10 

30440 

D 

0 

11 

19 

-0.20 

0.19 

0.63 

-0.40 

6 

11 

31041 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.01 

6 

11 

31041 

A 

1 

35 

63 

1.53 

0.20 

0.86 

0.55 

6 

11 

31041 

B 

0 

6 

11 

0.18 

0.38 

0.69 

-0.25 

6 

11 

31041 

C 

0 

7 

13 

0.30 

0.27 

0.72 

-0.23 

6 

11 

31041 

D 

0 

8 

14 

0.06 

0.14 

0.48 

-0.33 

6 

12 

30296 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.04 

6 

12 

30296 

A 

1 

28 

47 

1.18 

0.19 

1.00 

0.38 

6 

12 

30296 

B 

0 

19 

32 

0.61 

0.26 

1.61 

-0.08 

6 

12 

30296 

C 

0 

9 

15 

-0.16 

0.33 

0.56 

-0.35 

6 

12 

30296 

D 

0 

4 

7 

0.26 

0.12 

0.62 

-0.12 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

6 

13 

3G138 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.08 

6 

13 

3G138 

A 

1 

69 

59 

2.18 

0.14 

1.29 

0.27 

6 

13 

3G138 

B 

0 

13 

11 

1.59 

0.22 

1.14 

-0.12 

6 

13 

3G138 

C 

0 

34 

29 

1.60 

0.14 

1.11 

-0.20 

6 

13 

3G138 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

14 

30547 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.02 

6 

14 

30547 

A 

1 

53 

88 

1.12 

0.12 

0.83 

0.44 

6 

14 

30547 

B 

0 

2 

3 

0.53 

0.50 

1.05 

-0.08 

6 

14 

30547 

C 

0 

3 

5 

-0.71 

1.08 

0.82 

-0.37 

6 

14 

30547 

D 

0 

2 

3 

-0.42 

0.41 

0.39 

-0.25 

6 

15 

30363 

* 

-1 

4928 

99 

1.21 

0.02 

0.00 

0.03 

6 

15 

30363 

A 

1 

54 

82 

1.09 

0.16 

1.12 

0.43 

6 

15 

30363 

B 

0 

7 

11 

0.25 

0.18 

0.92 

-0.16 

6 

15 

30363 

C 

0 

1 

2 

-0.73 

0.00 

0.31 

-0.15 

6 

15 

30363 

D 

0 

4 

6 

-1.18 

0.68 

0.34 

-0.40 

6 

16 

30990 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.02 

6 

16 

30990 

A 

1 

46 

81 

1.05 

0.16 

1.09 

0.21 

6 

16 

30990 

B 

0 

4 

7 

0.47 

0.12 

0.84 

-0.13 

6 

16 

30990 

C 

0 

4 

7 

1.22 

0.34 

2.11 

0.07 

6 

16 

30990 

D 

0 

3 

5 

-0.44 

0.34 

0.37 

-0.32 

6 

17 

30809 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.05 

6 

17 

30809 

A 

1 

38 

67 

0.90 

0.16 

0.87 

0.44 

6 

17 

30809 

B 

0 

4 

7 

0.26 

0.46 

1.23 

-0.07 

6 

17 

30809 

C 

0 

3 

5 

0.18 

0.22 

0.86 

-0.08 

6 

17 

30809 

D 

0 

12 

21 

-0.40 

0.38 

0.97 

-0.43 

6 

18 

30806 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.02 

6 

18 

30806 

A 

1 

36 

63 

1.27 

0.15 

0.89 

0.49 

6 

18 

30806 

B 

0 

6 

11 

0.38 

0.26 

0.76 

-0.19 

6 

18 

30806 

C 

0 

3 

5 

0.51 

0.21 

0.79 

-0.10 

6 

18 

30806 

D 

0 

12 

21 

0.18 

0.29 

0.87 

-0.39 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

6 

19 

30353 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

6 

19 

30353 

A 

1 

23 

41 

1.20 

0.24 

1.20 

0.32 

6 

19 

30353 

B 

0 

30 

54 

0.61 

0.17 

1.28 

-0.11 

6 

19 

30353 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

19 

30353 

D 

0 

3 

5 

-1.67 

1.06 

0.24 

-0.47 

6 

20 

30071 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.03 

6 

20 

30071 

A 

1 

8 

14 

1.89 

0.57 

1.00 

0.40 

6 

20 

30071 

B 

0 

32 

55 

0.58 

0.17 

0.86 

-0.20 

6 

20 

30071 

C 

0 

5 

9 

0.91 

0.36 

1.02 

0.04 

6 

20 

30071 

D 

0 

13 

22 

0.54 

0.25 

0.75 

-0.12 

6 

21 

30754 

* 

-1 

4950 

99 

1.21 

0.02 

0.00 

0.02 

6 

21 

30754 

A 

1 

38 

86 

1.15 

0.13 

0.87 

0.51 

6 

21 

30754 

B 

0 

1 

2 

-0.34 

0.00 

0.36 

-0.22 

6 

21 

30754 

C 

0 

1 

2 

0.07 

0.00 

0.54 

-0.15 

6 

21 

30754 

D 

0 

4 

9 

-0.25 

0.43 

0.50 

-0.42 

6 

22 

30934 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.01 

6 

22 

30934 

A 

1 

47 

84 

1.27 

0.13 

0.88 

0.43 

6 

22 

30934 

B 

0 

6 

11 

0.16 

0.22 

0.60 

-0.33 

6 

22 

30934 

C 

0 

3 

5 

0.00 

0.71 

0.74 

-0.26 

6 

22 

30934 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

23 

30A118 

* 

-1 

4888 

98 

1.20 

0.02 

0.00 

-0.04 

6 

23 

30A118 

A 

1 

90 

85 

1.79 

0.12 

0.92 

0.36 

6 

23 

30A118 

B 

0 

5 

5 

0.70 

0.55 

1.01 

-0.17 

6 

23 

30A118 

C 

0 

11 

10 

0.55 

0.33 

0.97 

-0.31 

6 

23 

30A118 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

24 

30A813 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.10 

6 

24 

30A813 

A 

1 

90 

78 

2.23 

0.13 

1.11 

0.29 

6 

24 

30A813 

B 

0 

10 

9 

0.92 

0.26 

0.63 

-0.28 

6 

24 

30A813 

C 

0 

16 

14 

1.68 

0.21 

1.33 

-0.12 

6 

24 

30A813 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

6 

25 

30195 

* 

-1 

4942 

99 

1.21 

0.02 

0.00 

0.01 

6 

25 

30195 

A 

1 

29 

56 

1.50 

0.20 

0.96 

0.46 

6 

25 

30195 

B 

0 

4 

8 

1.02 

0.23 

1.16 

0.00 

6 

25 

30195 

C 

0 

7 

13 

0.59 

0.37 

1.08 

-0.15 

6 

25 

30195 

D 

0 

12 

23 

0.13 

0.30 

0.68 

-0.42 

6 

26 

30041 

* 

-1 

4944 

99 

1.21 

0.02 

0.00 

0.04 

6 

26 

30041 

A 

1 

17 

34 

1.73 

0.31 

0.60 

0.63 

6 

26 

30041 

B 

0 

19 

38 

0.15 

0.19 

0.80 

-0.30 

6 

26 

30041 

C 

0 

5 

10 

0.05 

0.47 

0.76 

-0.15 

6 

26 

30041 

D 

0 

9 

18 

-0.15 

0.25 

0.55 

-0.29 

6 

27 

30A89 

* 

-1 

4875 

98 

1.19 

0.02 

0.00 

-0.09 

6 

27 

30A89 

A 

1 

50 

42 

2.43 

0.19 

1.29 

0.32 

6 

27 

30A89 

B 

0 

30 

25 

1.34 

0.16 

0.77 

-0.30 

6 

27 

30A89 

C 

0 

39 

33 

1.88 

0.18 

1.75 

-0.06 

6 

27 

30A89 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

28 

3NBT210 

* 

-1 

4874 

98 

1.18 

0.02 

0.00 

-0.10 

6 

28 

3NBT210 

A 

1 

99 

83 

2.25 

0.12 

0.96 

0.34 

6 

28 

3NBT210 

B 

0 

14 

12 

1.18 

0.33 

1.45 

-0.25 

6 

28 

3NBT210 

C 

0 

7 

6 

1.02 

0.40 

0.91 

-0.21 

6 

28 

3NBT210 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

29 

3NBT115 

* 

-1 

4877 

98 

1.19 

0.02 

0.00 

-0.07 

6 

29 

3NBT115 

A 

1 

82 

70 

2.09 

0.13 

1.06 

0.35 

6 

29 

3NBT115 

B 

0 

22 

19 

1.18 

0.19 

1.01 

-0.26 

6 

29 

3NBT115 

C 

0 

13 

11 

1.21 

0.20 

0.87 

-0.19 

6 

29 

3NBT115 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

30 

3NBT226 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.07 

6 

30 

3NBT226 

A 

1 

72 

62 

2.23 

0.13 

0.93 

0.45 

6 

30 

3NBT226 

B 

0 

25 

22 

1.42 

0.19 

1.23 

-0.18 

6 

30 

3NBT226 

C 

0 

19 

16 

0.79 

0.14 

0.52 

-0.39 

6 

30 

3NBT226 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

7 

1 

3NF211 

* 

-1 

4877 

98 

1.19 

0.02 

0.00 

-0.10 

7 

1 

3NF211 

A 

1 

106 

91 

2.19 

0.11 

0.89 

0.40 

7 

1 

3NF211 

B 

0 

5 

4 

0.20 

0.21 

0.29 

-0.32 

7 

1 

3NF211 

C 

0 

6 

5 

0.80 

0.30 

0.60 

-0.24 

7 

1 

3NF211 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

2 

3NF270 

* 

-1 

4880 

98 

1.19 

0.02 

0.00 

-0.10 

7 

2 

3NF270 

A 

1 

86 

75 

2.28 

0.13 

1.05 

0.32 

7 

2 

3NF270 

B 

0 

19 

17 

1.72 

0.24 

1.61 

-0.12 

7 

2 

3NF270 

C 

0 

9 

8 

0.65 

0.23 

0.44 

-0.34 

7 

2 

3NF270 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

3 

3NF255 

* 

-1 

4887 

98 

1.18 

0.02 

0.00 

-0.11 

7 

3 

3NF255 

A 

1 

70 

65 

2.80 

0.17 

1.02 

0.53 

7 

3 

3NF255 

B 

0 

24 

22 

1.42 

0.22 

1.13 

-0.29 

7 

3 

3NF255 

C 

0 

13 

12 

0.61 

0.26 

0.49 

-0.40 

7 

3 

3NF255 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

4 

3MD65 

* 

-1 

4880 

98 

1.19 

0.02 

0.00 

-0.07 

7 

4 

3MD65 

A 

1 

96 

84 

1.97 

0.11 

0.98 

0.35 

7 

4 

3MD65 

B 

0 

12 

11 

1.02 

0.22 

0.85 

-0.24 

7 

4 

3MD65 

C 

0 

6 

5 

0.66 

0.20 

0.50 

-0.24 

7 

4 

3MD65 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

5 

3MD69 

* 

-1 

4888 

98 

1.17 

0.02 

0.00 

-0.17 

7 

5 

3MD69 

A 

1 

87 

82 

3.01 

0.12 

0.87 

0.52 

7 

5 

3MD69 

B 

0 

14 

13 

1.18 

0.19 

0.42 

-0.47 

7 

5 

3MD69 

C 

0 

5 

5 

1.71 

0.40 

0.82 

-0.18 

7 

5 

3MD69 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

6 

3MD32 

* 

-1 

4886 

98 

1.19 

0.02 

0.00 

-0.07 

7 

6 

3MD32 

A 

1 

53 

49 

2.03 

0.14 

1.49 

0.21 

7 

6 

3MD32 

B 

0 

31 

29 

1.62 

0.19 

1.59 

-0.11 

7 

6 

3MD32 

C 

0 

24 

22 

1.53 

0.22 

1.20 

-0.14 

7 

6 

3MD32 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

7 

7 

30552 

* 

-1 

4952 

99 

1.21 

0.02 

0.00 

0.03 

7 

7 

30552 

A 

1 

38 

90 

0.87 

0.16 

0.98 

0.28 

7 

7 

30552 

B 

0 

1 

2 

-0.64 

0.00 

0.33 

-0.24 

7 

7 

30552 

C 

0 

3 

7 

0.18 

0.25 

0.79 

-0.18 

7 

7 

30552 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

8 

30555 

* 

-1 

4943 

99 

1.21 

0.02 

0.00 

0.04 

7 

8 

30555 

A 

1 

42 

82 

0.84 

0.17 

1.01 

0.33 

7 

8 

30555 

B 

0 

1 

2 

0.84 

0.00 

1.67 

0.02 

7 

8 

30555 

C 

0 

6 

12 

-0.14 

0.33 

0.82 

-0.27 

7 

8 

30555 

D 

0 

2 

4 

-0.54 

0.41 

0.45 

-0.22 

7 

9 

30719 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.04 

7 

9 

30719 

A 

1 

42 

78 

0.91 

0.13 

0.92 

0.40 

7 

9 

30719 

B 

0 

6 

11 

0.68 

0.29 

1.58 

-0.01 

7 

9 

30719 

C 

0 

2 

4 

-0.05 

1.01 

0.93 

-0.15 

7 

9 

30719 

D 

0 

4 

7 

-1.11 

0.11 

0.21 

-0.52 

7 

10 

31183 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.04 

7 

10 

31183 

A 

1 

37 

69 

1.02 

0.14 

0.81 

0.50 

7 

10 

31183 

B 

0 

7 

13 

0.19 

0.62 

2.62 

-0.16 

7 

10 

31183 

C 

0 

9 

17 

-0.41 

0.26 

0.52 

-0.43 

7 

10 

31183 

D 

0 

1 

2 

-0.33 

0.00 

0.45 

-0.12 

7 

11 

30876 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.01 

7 

11 

30876 

A 

1 

37 

64 

1.33 

0.18 

1.35 

0.24 

7 

11 

30876 

B 

0 

7 

12 

0.88 

0.40 

1.26 

-0.09 

7 

11 

30876 

C 

0 

11 

19 

0.72 

0.29 

1.08 

-0.19 

7 

11 

30876 

D 

0 

3 

5 

0.82 

0.60 

1.08 

-0.07 

7 

12 

31191 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.02 

7 

12 

31191 

A 

1 

26 

48 

1.46 

0.21 

0.90 

0.49 

7 

12 

31191 

B 

0 

5 

9 

0.76 

0.23 

0.97 

-0.04 

7 

12 

31191 

C 

0 

15 

28 

0.30 

0.29 

0.90 

-0.32 

7 

12 

31191 

D 

0 

8 

15 

0.19 

0.28 

0.65 

-0.26 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

7 

13 

31024 

* 

-1 

4947 

99 

1.21 

0.02 

0.00 

0.04 

7 

13 

31024 

A 

1 

16 

34 

1.28 

0.22 

0.89 

0.49 

7 

13 

31024 

B 

0 

7 

15 

0.34 

0.18 

0.69 

-0.20 

7 

13 

31024 

C 

0 

16 

34 

0.51 

0.16 

0.91 

-0.18 

7 

13 

31024 

D 

0 

8 

17 

0.36 

0.27 

0.83 

-0.20 

7 

14 

30232 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.06 

7 

14 

30232 

A 

1 

46 

82 

0.60 

0.16 

1.01 

0.35 

7 

14 

30232 

B 

0 

2 

4 

-0.74 

0.89 

0.61 

-0.21 

7 

14 

30232 

C 

0 

3 

5 

0.39 

0.35 

1.47 

-0.01 

7 

14 

30232 

D 

0 

5 

9 

-0.66 

0.17 

0.49 

-0.32 

7 

15 

30089 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.04 

7 

15 

30089 

A 

1 

50 

83 

0.95 

0.12 

0.88 

0.39 

7 

15 

30089 

B 

0 

4 

7 

-0.74 

0.31 

0.35 

-0.40 

7 

15 

30089 

C 

0 

3 

5 

1.07 

0.75 

2.93 

0.07 

7 

15 

30089 

D 

0 

3 

5 

-0.43 

0.86 

0.84 

-0.27 

7 

16 

30364 

* 

-1 

4947 

99 

1.21 

0.02 

0.00 

0.04 

7 

16 

30364 

A 

1 

37 

79 

0.87 

0.17 

1.02 

0.33 

7 

16 

30364 

B 

0 

8 

17 

0.14 

0.28 

0.94 

-0.25 

7 

16 

30364 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

16 

30364 

D 

0 

2 

4 

-0.26 

0.64 

0.60 

-0.20 

7 

17 

30670 

* 

-1 

4936 

99 

1.22 

0.02 

0.00 

0.07 

7 

17 

30670 

A 

1 

37 

64 

0.81 

0.17 

1.02 

0.41 

7 

17 

30670 

B 

0 

16 

28 

0.12 

0.22 

1.14 

-0.12 

7 

17 

30670 

C 

0 

2 

3 

0.08 

0.05 

0.77 

-0.04 

7 

17 

30670 

D 

0 

3 

5 

-3.20 

1.32 

0.13 

-0.61 

7 

18 

30803 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.01 

7 

18 

30803 

A 

1 

36 

67 

1.47 

0.13 

0.82 

0.55 

7 

18 

30803 

B 

0 

3 

6 

-0.35 

0.47 

0.32 

-0.38 

7 

18 

30803 

C 

0 

9 

17 

0.37 

0.20 

0.63 

-0.35 

7 

18 

30803 

D 

0 

6 

11 

0.74 

0.33 

1.00 

-0.14 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

7 

19 

30982 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.00 

7 

19 

30982 

A 

1 

28 

50 

1.69 

0.21 

1.13 

0.44 

7 

19 

30982 

B 

0 

12 

21 

1.10 

0.29 

1.31 

-0.03 

7 

19 

30982 

C 

0 

2 

4 

1.62 

0.29 

1.59 

0.07 

7 

19 

30982 

D 

0 

14 

25 

0.14 

0.25 

0.52 

-0.50 

7 

20 

30077 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.01 

7 

20 

30077 

A 

1 

10 

17 

1.97 

0.42 

1.10 

0.37 

7 

20 

30077 

B 

0 

32 

55 

1.02 

0.18 

1.45 

-0.05 

7 

20 

30077 

C 

0 

3 

5 

0.55 

0.56 

0.59 

-0.11 

7 

20 

30077 

D 

0 

13 

22 

0.63 

0.23 

0.61 

-0.21 

7 

21 

30346 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

7 

21 

30346 

A 

1 

47 

82 

1.10 

0.13 

0.82 

0.55 

7 

21 

30346 

B 

0 

2 

4 

-0.10 

0.07 

0.54 

-0.12 

7 

21 

30346 

C 

0 

2 

4 

0.43 

0.87 

1.27 

-0.04 

7 

21 

30346 

D 

0 

6 

11 

-1.65 

0.98 

0.56 

-0.59 

7 

22 

30166 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.02 

7 

22 

30166 

A 

1 

46 

81 

1.22 

0.16 

0.83 

0.52 

7 

22 

30166 

B 

0 

7 

12 

0.02 

0.25 

0.68 

-0.29 

7 

22 

30166 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

22 

30166 

D 

0 

4 

7 

-0.90 

0.14 

0.24 

-0.43 

7 

23 

30308 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.02 

7 

23 

30308 

A 

1 

41 

77 

1.13 

0.17 

1.05 

0.25 

7 

23 

30308 

B 

0 

7 

13 

0.59 

0.48 

1.69 

-0.14 

7 

23 

30308 

C 

0 

2 

4 

0.29 

0.92 

0.99 

-0.12 

7 

23 

30308 

D 

0 

3 

6 

0.33 

0.25 

0.75 

-0.14 

7 

24 

30481 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

7 

24 

30481 

A 

1 

32 

57 

1.24 

0.17 

0.87 

0.46 

7 

24 

30481 

B 

0 

2 

4 

0.75 

0.09 

1.02 

0.00 

7 

24 

30481 

C 

0 

14 

25 

0.27 

0.29 

0.93 

-0.23 

7 

24 

30481 

D 

0 

8 

14 

-0.32 

0.62 

0.68 

-0.36 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

7 

25 

30946 

* 

-1 

4932 

99 

1.22 

0.02 

0.00 

0.06 

7 

25 

30946 

A 

1 

27 

44 

0.73 

0.19 

1.18 

0.24 

7 

25 

30946 

B 

0 

23 

37 

0.40 

0.21 

1.54 

-0.03 

7 

25 

30946 

C 

0 

7 

11 

0.26 

0.32 

1.10 

-0.06 

7 

25 

30946 

D 

0 

5 

8 

-0.64 

0.64 

0.66 

-0.31 

7 

26 

30768 

* 

-1 

4932 

99 

1.21 

0.02 

0.00 

0.05 

7 

26 

30768 

A 

1 

22 

35 

1.25 

0.26 

1.51 

0.41 

7 

26 

30768 

B 

0 

27 

44 

0.57 

0.15 

1.07 

-0.06 

7 

26 

30768 

C 

0 

5 

8 

-0.31 

0.35 

0.44 

-0.26 

7 

26 

30768 

D 

0 

8 

13 

-0.20 

0.33 

0.58 

-0.30 

7 

27 

30905 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

7 

27 

30905 

A 

1 

13 

23 

1.58 

0.38 

1.17 

0.40 

7 

27 

30905 

B 

0 

9 

16 

0.57 

0.24 

0.81 

-0.06 

7 

27 

30905 

C 

0 

12 

21 

0.55 

0.31 

0.98 

-0.08 

7 

27 

30905 

D 

0 

22 

39 

0.41 

0.22 

0.84 

-0.23 

7 

28 

3NBT326 

* 

-1 

4872 

98 

1.19 

0.02 

0.00 

-0.08 

7 

28 

3NBT326 

A 

1 

96 

79 

2.25 

0.12 

0.90 

0.53 

7 

28 

3NBT326 

B 

0 

5 

4 

0.60 

0.21 

0.44 

-0.21 

7 

28 

3NBT326 

C 

0 

21 

17 

0.62 

0.16 

0.53 

-0.46 

7 

28 

3NBT326 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

29 

3NBT315 

* 

-1 

4888 

98 

1.20 

0.02 

0.00 

-0.04 

7 

29 

3NBT315 

A 

1 

71 

67 

2.00 

0.13 

0.93 

0.46 

7 

29 

3NBT315 

B 

0 

11 

10 

0.81 

0.37 

1.01 

-0.23 

7 

29 

3NBT315 

C 

0 

24 

23 

0.85 

0.16 

0.78 

-0.35 

7 

29 

3NBT315 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

30 

3NBT134 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.11 

7 

30 

3NBT134 

A 

1 

76 

68 

2.45 

0.13 

1.00 

0.39 

7 

30 

3NBT134 

B 

0 

20 

18 

1.55 

0.19 

0.99 

-0.25 

7 

30 

3NBT134 

C 

0 

15 

14 

1.48 

0.24 

0.89 

-0.24 

7 

30 

3NBT134 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

8 

1 

3NF220 

* 

-1 

4865 

97 

1.19 

0.02 

0.00 

-0.09 

8 

1 

3NF220 

A 

1 

118 

91 

2.05 

0.11 

0.95 

0.28 

8 

1 

3NF220 

B 

0 

7 

5 

0.75 

0.44 

0.80 

-0.23 

8 

1 

3NF220 

C 

0 

4 

3 

0.89 

0.45 

0.78 

-0.15 

8 

1 

3NF220 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

2 

3NF241 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.10 

8 

2 

3NF241 

A 

1 

87 

75 

2.31 

0.13 

1.03 

0.38 

8 

2 

3NF241 

B 

0 

19 

16 

1.18 

0.22 

0.98 

-0.31 

8 

2 

3NF241 

C 

0 

10 

9 

1.35 

0.28 

1.01 

-0.17 

8 

2 

3NF241 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

3 

3NF252 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.08 

8 

3 

3NF252 

A 

1 

70 

60 

2.33 

0.13 

1.00 

0.44 

8 

3 

3NF252 

B 

0 

21 

18 

1.30 

0.18 

0.84 

-0.28 

8 

3 

3NF252 

C 

0 

25 

22 

1.40 

0.14 

0.87 

-0.26 

8 

3 

3NF252 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

4 

3MD212 

* 

-1 

4883 

98 

1.20 

0.02 

0.00 

-0.04 

8 

4 

3MD212 

A 

1 

90 

81 

1.74 

0.13 

1.02 

0.35 

8 

4 

3MD212 

B 

0 

13 

12 

0.79 

0.21 

0.89 

-0.23 

8 

4 

3MD212 

C 

0 

8 

7 

0.51 

0.29 

0.69 

-0.24 

8 

4 

3MD212 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

5 

3MD23 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.10 

8 

5 

3MD23 

A 

1 

84 

72 

2.38 

0.13 

0.93 

0.45 

8 

5 

3MD23 

B 

0 

8 

7 

1.16 

0.35 

0.83 

-0.20 

8 

5 

3MD23 

C 

0 

24 

21 

1.16 

0.18 

0.86 

-0.37 

8 

5 

3MD23 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

6 

3MD89 

* 

-1 

4876 

98 

1.19 

0.02 

0.00 

-0.10 

8 

6 

3MD89 

A 

1 

62 

53 

2.58 

0.15 

0.93 

0.44 

8 

6 

3MD89 

B 

0 

23 

19 

0.94 

0.20 

0.57 

-0.44 

8 

6 

3MD89 

C 

0 

33 

28 

1.87 

0.17 

1.52 

-0.10 

8 

6 

3MD89 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

8 

7 

30129 

* 

-1 

4946 

99 

1.21 

0.02 

0.00 

0.03 

8 

7 

30129 

A 

1 

43 

90 

0.86 

0.16 

0.94 

0.25 

8 

7 

30129 

B 

0 

2 

4 

-0.34 

0.58 

0.58 

-0.22 

8 

7 

30129 

C 

0 

3 

6 

0.21 

0.96 

1.55 

-0.14 

8 

7 

30129 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

8 

30450 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

8 

8 

30450 

A 

1 

48 

84 

1.11 

0.15 

0.92 

0.51 

8 

8 

30450 

B 

0 

1 

2 

-1.34 

0.00 

0.16 

-0.26 

8 

8 

30450 

C 

0 

3 

5 

0.03 

0.47 

0.80 

-0.18 

8 

8 

30450 

D 

0 

5 

9 

-0.57 

0.23 

0.39 

-0.40 

8 

9 

30432 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.05 

8 

9 

30432 

A 

1 

44 

77 

0.72 

0.14 

1.10 

0.21 

8 

9 

30432 

B 

0 

9 

16 

0.56 

0.26 

1.50 

-0.03 

8 

9 

30432 

C 

0 

3 

5 

-0.38 

0.41 

0.54 

-0.26 

8 

9 

30432 

D 

0 

1 

2 

-0.36 

0.00 

0.46 

-0.15 

8 

10 

3G153 

* 

-1 

4886 

98 

1.20 

0.02 

0.00 

-0.04 

8 

10 

3G153 

A 

1 

88 

81 

1.71 

0.13 

1.02 

0.29 

8 

10 

3G153 

B 

0 

11 

10 

0.57 

0.26 

0.79 

-0.27 

8 

10 

3G153 

C 

0 

9 

8 

1.12 

0.34 

1.36 

-0.11 

8 

10 

3G153 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

11 

31018 

* 

-1 

4949 

99 

1.21 

0.02 

0.00 

0.00 

8 

11 

31018 

A 

1 

29 

64 

1.45 

0.23 

1.40 

0.27 

8 

11 

31018 

B 

0 

7 

16 

0.39 

0.27 

0.63 

-0.30 

8 

11 

31018 

C 

0 

8 

18 

1.20 

0.39 

1.88 

-0.01 

8 

11 

31018 

D 

0 

1 

2 

0.35 

0.00 

0.50 

-0.11 

8 

12 

3G1 1 

* 

-1 

4877 

98 

1.20 

0.02 

0.00 

-0.03 

8 

12 

3G1 1 

A 

1 

70 

60 

1.97 

0.14 

0.96 

0.50 

8 

12 

3G1 1 

B 

0 

38 

32 

0.73 

0.17 

0.87 

-0.38 

8 

12 

3G11 

C 

0 

9 

8 

0.28 

0.29 

0.51 

-0.26 

8 

12 

3G11 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

8 

13 

30893 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.03 

8 

13 

30893 

A 

1 

22 

37 

1.20 

0.21 

1.23 

0.27 

8 

13 

30893 

B 

0 

8 

14 

0.93 

0.44 

1.65 

0.03 

8 

13 

30893 

C 

0 

10 

17 

0.59 

0.28 

0.94 

-0.13 

8 

13 

30893 

D 

0 

19 

32 

0.59 

0.19 

0.94 

-0.20 

8 

14 

30545 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.05 

8 

14 

30545 

A 

1 

47 

84 

0.85 

0.13 

0.77 

0.54 

8 

14 

30545 

B 

0 

3 

5 

-0.87 

0.77 

0.58 

-0.31 

8 

14 

30545 

C 

0 

1 

2 

-1.42 

0.00 

0.19 

-0.24 

8 

14 

30545 

D 

0 

5 

9 

-0.58 

0.55 

0.66 

-0.33 

8 

15 

30386 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.02 

8 

15 

30386 

A 

1 

47 

84 

1.20 

0.18 

1.06 

0.44 

8 

15 

30386 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

15 

30386 

C 

0 

5 

9 

-0.14 

0.21 

0.57 

-0.27 

8 

15 

30386 

D 

0 

4 

7 

-0.54 

0.62 

0.56 

-0.33 

8 

16 

30056 

* 

-1 

4943 

99 

1.21 

0.02 

0.00 

0.03 

8 

16 

30056 

A 

1 

40 

78 

1.13 

0.21 

0.91 

0.43 

8 

16 

30056 

B 

0 

2 

4 

-0.60 

0.22 

0.39 

-0.21 

8 

16 

30056 

C 

0 

7 

14 

-0.01 

0.21 

0.79 

-0.24 

8 

16 

30056 

D 

0 

2 

4 

-1.22 

1.45 

0.46 

-0.30 

8 

17 

30838 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

8 

17 

30838 

A 

1 

40 

70 

0.96 

0.13 

0.90 

0.43 

8 

17 

30838 

B 

0 

9 

16 

0.39 

0.36 

1.31 

-0.13 

8 

17 

30838 

C 

0 

2 

4 

0.60 

0.14 

1.09 

-0.02 

8 

17 

30838 

D 

0 

6 

11 

-0.69 

0.28 

0.37 

-0.48 

8 

18 

30969 

* 

-1 

4946 

99 

1.21 

0.02 

0.00 

0.05 

8 

18 

30969 

A 

1 

27 

56 

1.23 

0.18 

0.72 

0.64 

8 

18 

30969 

B 

0 

6 

13 

-0.04 

0.21 

0.65 

-0.20 

8 

18 

30969 

C 

0 

6 

13 

-0.26 

0.45 

0.77 

-0.27 

8 

18 

30969 

D 

0 

9 

19 

-0.44 

0.35 

0.54 

-0.41 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

8 

19 

30679 

* 

-1 

4930 

99 

1.21 

0.02 

0.00 

0.04 

8 

19 

30679 

A 

1 

22 

34 

1.53 

0.21 

0.83 

0.51 

8 

19 

30679 

B 

0 

12 

19 

0.60 

0.30 

1.37 

-0.05 

8 

19 

30679 

C 

0 

8 

13 

0.54 

0.35 

0.98 

-0.06 

8 

19 

30679 

D 

0 

22 

34 

0.03 

0.22 

0.75 

-0.43 

8 

20 

30690 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.03 

8 

20 

30690 

A 

1 

7 

13 

2.04 

0.69 

0.94 

0.41 

8 

20 

30690 

B 

0 

39 

74 

0.67 

0.15 

1.03 

-0.23 

8 

20 

30690 

C 

0 

2 

4 

0.61 

0.10 

0.65 

-0.04 

8 

20 

30690 

D 

0 

5 

9 

0.43 

0.31 

0.65 

-0.11 

8 

21 

30629 

* 

-1 

4927 

99 

1.21 

0.02 

0.00 

0.01 

8 

21 

30629 

A 

1 

57 

85 

1.27 

0.16 

0.92 

0.44 

8 

21 

30629 

B 

0 

6 

9 

-0.10 

0.22 

0.57 

-0.29 

8 

21 

30629 

C 

0 

2 

3 

-0.84 

0.26 

0.25 

-0.27 

8 

21 

30629 

D 

0 

2 

3 

-0.16 

0.17 

0.48 

-0.17 

8 

22 

30198 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.06 

8 

22 

30198 

A 

1 

41 

75 

0.71 

0.13 

0.86 

0.48 

8 

22 

30198 

B 

0 

4 

7 

0.48 

0.46 

1.74 

0.01 

8 

22 

30198 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

22 

30198 

D 

0 

10 

18 

-0.72 

0.23 

0.49 

-0.55 

8 

23 

30497 

* 

-1 

4933 

99 

1.21 

0.02 

0.00 

0.03 

8 

23 

30497 

A 

1 

45 

74 

1.03 

0.19 

1.12 

0.30 

8 

23 

30497 

B 

0 

3 

5 

0.38 

0.39 

1.02 

-0.08 

8 

23 

30497 

C 

0 

2 

3 

-0.11 

0.11 

0.53 

-0.15 

8 

23 

30497 

D 

0 

11 

18 

0.26 

0.23 

0.96 

-0.22 

8 

24 

30913 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

8 

24 

30913 

A 

1 

32 

56 

1.15 

0.16 

0.95 

0.44 

8 

24 

30913 

B 

0 

8 

14 

0.50 

0.33 

1.09 

-0.11 

8 

24 

30913 

C 

0 

8 

14 

0.38 

0.22 

0.86 

-0.16 

8 

24 

30913 

D 

0 

9 

16 

-0.02 

0.33 

0.68 

-0.35 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

8 

25 

30929 

* 

-1 

4691 

94 

1.18 

0.02 

0.00 

-0.08 

8 

25 

30929 

A 

1 

199 

66 

2.15 

0.08 

0.88 

0.54 

8 

25 

30929 

B 

0 

50 

17 

0.62 

0.10 

0.58 

-0.33 

8 

25 

30929 

C 

0 

43 

14 

0.92 

0.15 

1.06 

-0.21 

8 

25 

30929 

D 

0 

11 

4 

-0.68 

0.48 

0.24 

-0.33 

8 

26 

30926 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.02 

8 

26 

30926 

A 

1 

22 

39 

1.34 

0.28 

1.13 

0.29 

8 

26 

30926 

B 

0 

1 

2 

4.56 

0.00 

40.05 

0.41 

8 

26 

30926 

C 

0 

8 

14 

0.87 

0.12 

1.07 

-0.01 

8 

26 

30926 

D 

0 

26 

46 

0.40 

0.17 

1.00 

-0.39 

8 

27 

30180 

* 

-1 

4942 

99 

1.21 

0.02 

0.00 

0.04 

8 

27 

30180 

A 

1 

11 

21 

1.56 

0.23 

0.78 

0.38 

8 

27 

30180 

B 

0 

8 

15 

0.68 

0.29 

0.90 

-0.01 

8 

27 

30180 

C 

0 

5 

10 

0.24 

0.87 

1.57 

-0.14 

8 

27 

30180 

D 

0 

28 

54 

0.47 

0.20 

0.91 

-0.23 

8 

28 

3NBT111 

* 

-1 

4885 

98 

1.18 

0.02 

0.00 

-0.11 

8 

28 

3NBT111 

A 

1 

87 

80 

2.58 

0.15 

0.84 

0.50 

8 

28 

3NBT111 

B 

0 

16 

15 

0.89 

0.30 

0.96 

-0.36 

8 

28 

3NBT111 

C 

0 

6 

6 

0.22 

0.31 

0.33 

-0.32 

8 

28 

3NBT111 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

29 

3NBT16 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.08 

8 

29 

3NBT16 

A 

1 

85 

73 

2.23 

0.11 

0.94 

0.44 

8 

29 

3NBT16 

B 

0 

22 

19 

1.26 

0.15 

0.86 

-0.31 

8 

29 

3NBT16 

C 

0 

9 

8 

0.88 

0.22 

0.56 

-0.29 

8 

29 

3NBT16 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

30 

3NBT221 

* 

-1 

4886 

98 

1.20 

0.02 

0.00 

-0.04 

8 

30 

3NBT221 

A 

1 

61 

56 

2.08 

0.15 

0.89 

0.50 

8 

30 

3NBT221 

B 

0 

31 

29 

0.72 

0.15 

0.74 

-0.43 

8 

30 

3NBT221 

C 

0 

16 

15 

1.10 

0.26 

1.22 

-0.15 

8 

30 

3NBT221 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

9 

1 

3NF234 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.11 

9 

1 

3NF234 

A 

1 

101 

91 

2.28 

0.11 

0.95 

0.34 

9 

1 

3NF234 

B 

0 

4 

4 

0.83 

0.26 

0.45 

-0.23 

9 

1 

3NF234 

C 

0 

6 

5 

1.04 

0.35 

0.65 

-0.24 

9 

1 

3NF234 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

2 

3NF276 

* 

-1 

4888 

98 

1.20 

0.02 

0.00 

-0.04 

9 

2 

3NF276 

A 

1 

72 

68 

1.92 

0.14 

1.10 

0.37 

9 

2 

3NF276 

B 

0 

21 

20 

1.10 

0.20 

1.07 

-0.22 

9 

2 

3NF276 

C 

0 

13 

12 

0.75 

0.21 

0.68 

-0.27 

9 

2 

3NF276 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

3 

3NF250 

* 

-1 

4873 

98 

1.19 

0.02 

0.00 

-0.09 

9 

3 

3NF250 

A 

1 

75 

62 

2.36 

0.15 

1.02 

0.40 

9 

3 

3NF250 

B 

0 

15 

12 

1.60 

0.23 

1.22 

-0.12 

9 

3 

3NF250 

C 

0 

31 

26 

1.24 

0.15 

0.81 

-0.36 

9 

3 

3NF250 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

4 

3MD53 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.12 

9 

4 

3MD53 

A 

1 

101 

91 

2.40 

0.12 

0.98 

0.24 

9 

4 

3MD53 

B 

0 

4 

4 

0.67 

0.30 

0.38 

-0.26 

9 

4 

3MD53 

C 

0 

6 

5 

1.82 

0.58 

2.12 

-0.09 

9 

4 

3MD53 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

5 

3MD37 

* 

-1 

4869 

97 

1.19 

0.02 

0.00 

-0.08 

9 

5 

3MD37 

A 

1 

85 

68 

2.35 

0.12 

0.92 

0.51 

9 

5 

3MD37 

B 

0 

26 

21 

1.07 

0.20 

0.92 

-0.34 

9 

5 

3MD37 

C 

0 

14 

11 

0.79 

0.21 

0.56 

-0.32 

9 

5 

3MD37 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

6 

3MD27 

* 

-1 

4869 

97 

1.18 

0.02 

0.00 

-0.12 

9 

6 

3MD27 

A 

1 

70 

56 

2.68 

0.13 

1.00 

0.47 

9 

6 

3MD27 

B 

0 

22 

18 

1.67 

0.18 

0.95 

-0.22 

9 

6 

3MD27 

C 

0 

33 

26 

1.57 

0.16 

0.81 

-0.34 

9 

6 

3MD27 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

9 

7 

30711 

* 

-1 

4944 

99 

1.21 

0.02 

0.00 

0.02 

9 

7 

30711 

A 

1 

46 

92 

0.97 

0.15 

1.04 

0.12 

9 

7 

30711 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

7 

30711 

C 

0 

4 

8 

0.54 

0.22 

0.96 

-0.12 

9 

7 

30711 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

8 

30103 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.01 

9 

8 

30103 

A 

1 

49 

86 

1.19 

0.15 

0.98 

0.36 

9 

8 

30103 

B 

0 

6 

11 

0.23 

0.42 

0.98 

-0.24 

9 

8 

30103 

C 

0 

2 

4 

-0.54 

1.07 

0.51 

-0.27 

9 

8 

30103 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

9 

30554 

* 

-1 

4953 

99 

1.21 

0.02 

0.00 

0.02 

9 

9 

30554 

A 

1 

33 

80 

1.07 

0.19 

1.07 

0.34 

9 

9 

30554 

B 

0 

1 

2 

-1.11 

0.00 

0.18 

-0.29 

9 

9 

30554 

C 

0 

3 

7 

0.35 

0.43 

0.91 

-0.14 

9 

9 

30554 

D 

0 

4 

10 

0.34 

0.28 

0.86 

-0.17 

9 

10 

31042 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.05 

9 

10 

31042 

A 

1 

39 

68 

0.85 

0.16 

1.09 

0.35 

9 

10 

31042 

B 

0 

7 

12 

0.46 

0.24 

1.21 

-0.06 

9 

10 

31042 

C 

0 

4 

7 

-0.04 

0.29 

0.67 

-0.19 

9 

10 

31042 

D 

0 

7 

12 

-0.10 

0.30 

0.69 

-0.28 

9 

11 

30569 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.02 

9 

11 

30569 

A 

1 

34 

60 

1.41 

0.16 

0.81 

0.50 

9 

11 

30569 

B 

0 

3 

5 

0.80 

0.38 

1.09 

-0.02 

9 

11 

30569 

C 

0 

2 

4 

0.23 

1.18 

0.96 

-0.10 

9 

11 

30569 

D 

0 

18 

32 

0.03 

0.33 

0.84 

-0.47 

9 

12 

3G144 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.07 

9 

12 

3G144 

A 

1 

77 

66 

2.09 

0.14 

1.10 

0.33 

9 

12 

3G144 

B 

0 

7 

6 

1.31 

0.33 

1.04 

-0.11 

9 

12 

3G144 

C 

0 

32 

28 

1.27 

0.16 

1.08 

-0.29 

9 

12 

3G144 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

9 

13 

31161 

* 

-1 

4928 

99 

1.21 

0.02 

0.00 

0.00 

9 

13 

31161 

A 

1 

29 

44 

1.66 

0.16 

0.92 

0.42 

9 

13 

31161 

B 

0 

19 

29 

0.99 

0.21 

1.17 

-0.13 

9 

13 

31161 

C 

0 

11 

17 

1.06 

0.30 

1.16 

-0.06 

9 

13 

31161 

D 

0 

7 

11 

-0.03 

0.29 

0.35 

-0.42 

9 

14 

30836 

* 

-1 

4934 

99 

1.22 

0.02 

0.00 

0.06 

9 

14 

30836 

A 

1 

50 

83 

0.55 

0.10 

0.92 

0.30 

9 

14 

30836 

B 

0 

3 

5 

0.21 

0.78 

1.75 

-0.06 

9 

14 

30836 

C 

0 

5 

8 

-0.06 

0.53 

1.07 

-0.17 

9 

14 

30836 

D 

0 

2 

3 

-0.89 

0.94 

0.49 

-0.29 

9 

15 

30964 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.01 

9 

15 

30964 

A 

1 

51 

86 

1.11 

0.14 

1.04 

0.19 

9 

15 

30964 

B 

0 

1 

2 

0.70 

0.00 

1.00 

-0.04 

9 

15 

30964 

C 

0 

5 

8 

0.37 

0.48 

1.18 

-0.20 

9 

15 

30964 

D 

0 

2 

3 

0.89 

0.77 

1.58 

-0.03 

9 

16 

30357 

* 

-1 

4918 

98 

1.21 

0.02 

0.00 

0.04 

9 

16 

30357 

A 

1 

60 

79 

1.07 

0.14 

0.90 

0.45 

9 

16 

30357 

B 

0 

5 

7 

0.52 

0.10 

1.09 

-0.05 

9 

16 

30357 

C 

0 

8 

11 

-0.28 

0.35 

0.74 

-0.29 

9 

16 

30357 

D 

0 

3 

4 

-1.92 

1.46 

0.41 

-0.43 

9 

17 

30976 

* 

-1 

4944 

99 

1.21 

0.02 

0.00 

0.04 

9 

17 

30976 

A 

1 

35 

70 

0.84 

0.15 

1.01 

0.29 

9 

17 

30976 

B 

0 

6 

12 

0.61 

0.32 

1.46 

-0.02 

9 

17 

30976 

C 

0 

3 

6 

0.56 

0.63 

1.60 

-0.03 

9 

17 

30976 

D 

0 

6 

12 

-0.26 

0.39 

0.68 

-0.38 

9 

18 

30372 

* 

-1 

4721 

95 

1.15 

0.02 

0.00 

-0.16 

9 

18 

30372 

A 

1 

217 

79 

2.31 

0.09 

1.53 

0.32 

9 

18 

30372 

B 

0 

26 

10 

1.35 

0.22 

1.20 

-0.17 

9 

18 

30372 

C 

0 

28 

10 

1.20 

0.15 

0.90 

-0.22 

9 

18 

30372 

D 

0 

2 

1 

0.11 

0.91 

0.31 

-0.12 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

9 

19 

30531 

* 

-1 

4702 

94 

1.17 

0.02 

0.00 

-0.10 

9 

19 

30531 

A 

1 

160 

55 

2.42 

0.10 

1.00 

0.55 

9 

19 

30531 

B 

0 

12 

4 

0.95 

0.30 

0.86 

-0.12 

9 

19 

30531 

C 

0 

109 

37 

1.04 

0.08 

0.72 

-0.40 

9 

19 

30531 

D 

0 

11 

4 

-0.29 

0.45 

0.25 

-0.30 

9 

20 

30693 

* 

-1 

4932 

99 

1.21 

0.02 

0.00 

0.03 

9 

20 

30693 

A 

1 

8 

13 

1.97 

0.20 

0.55 

0.41 

9 

20 

30693 

B 

0 

10 

16 

1.38 

0.34 

1.95 

0.21 

9 

20 

30693 

C 

0 

11 

18 

1.14 

0.28 

1.33 

0.11 

9 

20 

30693 

D 

0 

33 

53 

0.41 

0.14 

0.58 

-0.52 

9 

21 

30167 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.04 

9 

21 

30167 

A 

1 

47 

81 

1.04 

0.17 

0.81 

0.48 

9 

21 

30167 

B 

0 

6 

10 

-0.37 

0.56 

1.02 

-0.29 

9 

21 

30167 

C 

0 

2 

3 

-1.13 

0.06 

0.24 

-0.27 

9 

21 

30167 

D 

0 

3 

5 

-0.51 

0.85 

0.93 

-0.22 

9 

22 

30303 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.06 

9 

22 

30303 

A 

1 

41 

73 

0.90 

0.17 

0.79 

0.59 

9 

22 

30303 

B 

0 

2 

4 

-0.31 

0.42 

0.67 

-0.12 

9 

22 

30303 

C 

0 

4 

7 

-1.03 

0.40 

0.37 

-0.34 

9 

22 

30303 

D 

0 

9 

16 

-0.69 

0.27 

0.60 

-0.41 

9 

23 

30795 

* 

-1 

4928 

99 

1.21 

0.02 

0.00 

0.06 

9 

23 

30795 

A 

1 

46 

70 

0.89 

0.16 

0.89 

0.47 

9 

23 

30795 

B 

0 

10 

15 

0.15 

0.20 

1.03 

-0.15 

9 

23 

30795 

C 

0 

5 

8 

-0.09 

0.19 

0.71 

-0.16 

9 

23 

30795 

D 

0 

5 

8 

-1.20 

0.31 

0.25 

-0.45 

9 

24 

30947 

* 

-1 

4932 

99 

1.21 

0.02 

0.00 

0.02 

9 

24 

30947 

A 

1 

37 

60 

1.49 

0.18 

0.96 

0.50 

9 

24 

30947 

B 

0 

12 

19 

0.52 

0.20 

0.88 

-0.18 

9 

24 

30947 

C 

0 

10 

16 

0.12 

0.45 

1.08 

-0.30 

9 

24 

30947 

D 

0 

3 

5 

-0.76 

0.10 

0.20 

-0.31 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

9 

25 

30178 

* 

-1 

4947 

99 

1.21 

0.02 

0.00 

0.02 

9 

25 

30178 

A 

1 

25 

53 

1.62 

0.20 

0.70 

0.60 

9 

25 

30178 

B 

0 

6 

13 

0.51 

0.46 

1.14 

-0.12 

9 

25 

30178 

C 

0 

2 

4 

0.44 

0.05 

0.65 

-0.08 

9 

25 

30178 

D 

0 

14 

30 

-0.15 

0.30 

0.53 

-0.54 

9 

26 

30A819 

* 

-1 

4888 

98 

1.20 

0.02 

0.00 

-0.04 

9 

26 

30A819 

A 

1 

57 

54 

2.04 

0.16 

1.25 

0.39 

9 

26 

30A819 

B 

0 

23 

22 

1.00 

0.19 

0.83 

-0.27 

9 

26 

30A819 

C 

0 

26 

25 

1.22 

0.20 

1.23 

-0.19 

9 

26 

30A819 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

27 

30485 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.05 

9 

27 

30485 

A 

1 

12 

20 

1.54 

0.42 

1.17 

0.41 

9 

27 

30485 

B 

0 

23 

39 

0.44 

0.19 

1.04 

-0.10 

9 

27 

30485 

C 

0 

6 

10 

0.29 

0.36 

0.83 

-0.09 

9 

27 

30485 

D 

0 

18 

31 

0.26 

0.25 

0.99 

-0.19 

9 

28 

3NBT32 

* 

-1 

4883 

98 

1.19 

0.02 

0.00 

-0.10 

9 

28 

3NBT32 

A 

1 

89 

80 

2.42 

0.13 

0.89 

0.49 

9 

28 

3NBT32 

B 

0 

9 

8 

0.57 

0.26 

0.44 

-0.34 

9 

28 

3NBT32 

C 

0 

13 

12 

0.94 

0.24 

0.67 

-0.32 

9 

28 

3NBT32 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

29 

3NBT212 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.07 

9 

29 

3NBT212 

A 

1 

82 

71 

2.13 

0.13 

1.00 

0.41 

9 

29 

3NBT212 

B 

0 

28 

24 

0.96 

0.13 

0.71 

-0.41 

9 

29 

3NBT212 

C 

0 

6 

5 

1.61 

0.34 

1.48 

-0.04 

9 

29 

3NBT212 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

30 

3NBT217 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.11 

9 

30 

3NBT217 

A 

1 

75 

68 

2.52 

0.12 

0.87 

0.46 

9 

30 

3NBT217 

B 

0 

24 

22 

1.26 

0.16 

0.67 

-0.42 

9 

30 

3NBT217 

C 

0 

12 

11 

1.72 

0.29 

1.21 

-0.14 

9 

30 

3NBT217 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

10 

1 

3NF221 

* 

-1 

4876 

98 

1.18 

0.02 

0.00 

-0.11 

10 

1 

3NF221 

A 

1 

109 

92 

2.23 

0.12 

0.98 

0.30 

10 

1 

3NF221 

B 

0 

9 

8 

0.73 

0.33 

0.75 

-0.30 

10 

1 

3NF221 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

1 

3NF221 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

2 

3NF275 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.12 

10 

2 

3NF275 

A 

1 

87 

78 

2.52 

0.13 

1.10 

0.33 

10 

2 

3NF275 

B 

0 

21 

19 

1.59 

0.18 

0.94 

-0.28 

10 

2 

3NF275 

C 

0 

3 

3 

1.07 

0.54 

0.56 

-0.17 

10 

2 

3NF275 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

3 

3NF320 

* 

-1 

4778 

96 

1.16 

0.02 

0.00 

-0.15 

10 

3 

3NF320 

A 

1 

126 

58 

2.87 

0.11 

0.95 

0.62 

10 

3 

3NF320 

B 

0 

17 

8 

1.52 

0.17 

0.80 

-0.14 

10 

3 

3NF320 

C 

0 

73 

34 

1.11 

0.10 

0.60 

-0.56 

10 

3 

3NF320 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

4 

3MD82 

* 

-1 

4769 

95 

1.17 

0.02 

0.00 

-0.11 

10 

4 

3MD82 

A 

1 

200 

89 

2.02 

0.07 

0.87 

0.41 

10 

4 

3MD82 

B 

0 

9 

4 

0.75 

0.33 

0.72 

-0.22 

10 

4 

3MD82 

C 

0 

16 

7 

0.57 

0.22 

0.56 

-0.34 

10 

4 

3MD82 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

5 

3MD75 

* 

-1 

4871 

98 

1.19 

0.02 

0.00 

-0.08 

10 

5 

3MD75 

A 

1 

84 

68 

2.15 

0.14 

1.17 

0.30 

10 

5 

3MD75 

B 

0 

13 

11 

0.99 

0.34 

1.08 

-0.25 

10 

5 

3MD75 

C 

0 

26 

21 

1.52 

0.20 

1.42 

-0.16 

10 

5 

3MD75 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

6 

3MD86 

* 

-1 

4887 

98 

1.20 

0.02 

0.00 

-0.04 

10 

6 

3MD86 

A 

1 

45 

42 

2.05 

0.21 

1.44 

0.36 

10 

6 

3MD86 

B 

0 

28 

26 

1.41 

0.20 

1.55 

-0.06 

10 

6 

3MD86 

C 

0 

34 

32 

0.95 

0.13 

0.74 

-0.33 

10 

6 

3MD86 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

10 

7 

30424 

* 

-1 

4943 

99 

1.21 

0.02 

0.00 

0.04 

10 

7 

30424 

A 

1 

45 

88 

0.79 

0.17 

0.96 

0.34 

10 

7 

30424 

B 

0 

1 

2 

-0.35 

0.00 

0.57 

-0.12 

10 

7 

30424 

C 

0 

2 

4 

0.43 

0.01 

1.24 

-0.04 

10 

7 

30424 

D 

0 

3 

6 

-0.99 

0.33 

0.33 

-0.36 

10 

8 

30416 

* 

-1 

4947 

99 

1.21 

0.02 

0.00 

0.03 

10 

8 

30416 

A 

1 

40 

85 

0.94 

0.14 

1.02 

0.30 

10 

8 

30416 

B 

0 

2 

4 

-0.13 

0.17 

0.50 

-0.23 

10 

8 

30416 

C 

0 

2 

4 

-0.12 

0.11 

0.50 

-0.23 

10 

8 

30416 

D 

0 

3 

6 

0.62 

0.22 

1.10 

-0.06 

10 

9 

30441 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.03 

10 

9 

30441 

A 

1 

47 

78 

1.16 

0.14 

0.76 

0.57 

10 

9 

30441 

B 

0 

2 

3 

-0.70 

0.94 

0.46 

-0.22 

10 

9 

30441 

C 

0 

3 

5 

-0.69 

0.92 

0.63 

-0.27 

10 

9 

30441 

D 

0 

8 

13 

-0.48 

0.48 

0.83 

-0.40 

10 

10 

31155 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.03 

10 

10 

31155 

A 

1 

42 

71 

1.10 

0.13 

0.82 

0.48 

10 

10 

31155 

B 

0 

11 

19 

0.36 

0.34 

1.32 

-0.20 

10 

10 

31155 

C 

0 

4 

7 

-0.58 

0.46 

0.38 

-0.36 

10 

10 

31155 

D 

0 

2 

3 

-0.70 

0.45 

0.30 

-0.27 

10 

11 

3G122 

* 

-1 

4876 

98 

1.18 

0.02 

0.00 

-0.11 

10 

11 

3G122 

A 

1 

92 

78 

2.34 

0.14 

1.07 

0.31 

10 

11 

3G122 

B 

0 

23 

19 

1.49 

0.23 

1.29 

-0.23 

10 

11 

3G122 

C 

0 

3 

3 

0.20 

0.16 

0.23 

-0.23 

10 

11 

3G122 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

12 

31025 

* 

-1 

4951 

99 

1.21 

0.02 

0.00 

0.02 

10 

12 

31025 

A 

1 

21 

49 

1.19 

0.27 

1.27 

0.21 

10 

12 

31025 

B 

0 

3 

7 

1.11 

0.71 

1.80 

0.04 

10 

12 

31025 

C 

0 

11 

26 

0.88 

0.20 

1.27 

-0.05 

10 

12 

31025 

D 

0 

8 

19 

0.43 

0.32 

0.87 

-0.25 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

10 

13 

30737 

* 

-1 

4953 

99 

1.21 

0.02 

0.00 

0.01 

10 

13 

30737 

A 

1 

17 

41 

1.52 

0.28 

1.28 

0.33 

10 

13 

30737 

B 

0 

8 

20 

1.14 

0.24 

1.20 

0.01 

10 

13 

30737 

C 

0 

5 

12 

1.44 

0.47 

1.95 

0.11 

10 

13 

30737 

D 

0 

11 

27 

0.31 

0.24 

0.60 

-0.46 

10 

14 

30503 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

10 

14 

30503 

A 

1 

49 

88 

1.03 

0.15 

0.91 

0.39 

10 

14 

30503 

B 

0 

1 

2 

-0.59 

0.00 

0.34 

-0.18 

10 

14 

30503 

C 

0 

1 

2 

-0.74 

0.00 

0.30 

-0.20 

10 

14 

30503 

D 

0 

5 

9 

-0.12 

0.56 

0.81 

-0.28 

10 

15 

30239 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.02 

10 

15 

30239 

A 

1 

49 

83 

1.03 

0.17 

1.16 

0.23 

10 

15 

30239 

B 

0 

7 

12 

-0.15 

0.29 

0.72 

-0.32 

10 

15 

30239 

C 

0 

2 

3 

2.09 

0.19 

5.11 

0.19 

10 

15 

30239 

D 

0 

1 

2 

-0.20 

0.00 

0.50 

-0.12 

10 

16 

30529 

* 

-1 

4932 

99 

1.21 

0.02 

0.00 

0.05 

10 

16 

30529 

A 

1 

47 

76 

0.85 

0.13 

0.89 

0.47 

10 

16 

30529 

B 

0 

5 

8 

-0.25 

0.28 

0.60 

-0.28 

10 

16 

30529 

C 

0 

10 

16 

-0.10 

0.19 

0.71 

-0.34 

10 

16 

30529 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

17 

30669 

* 

-1 

1962 

39 

1.87 

0.03 

0.00 

0.40 

10 

17 

30669 

A 

1 

2157 

71 

1.04 

0.02 

1.02 

0.37 

10 

17 

30669 

B 

0 

657 

22 

0.36 

0.04 

1.24 

-0.19 

10 

17 

30669 

C 

0 

74 

2 

-0.36 

0.10 

0.55 

-0.16 

10 

17 

30669 

D 

0 

144 

5 

-0.80 

0.11 

0.45 

-0.31 

10 

18 

30374 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

10 

18 

30374 

A 

1 

33 

59 

1.35 

0.25 

0.95 

0.46 

10 

18 

30374 

B 

0 

3 

5 

0.51 

0.11 

0.98 

-0.05 

10 

18 

30374 

C 

0 

9 

16 

-0.35 

0.35 

0.67 

-0.36 

10 

18 

30374 

D 

0 

11 

20 

0.19 

0.28 

1.03 

-0.22 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

10 

19 

30398 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

10 

19 

30398 

A 

1 

20 

35 

1.27 

0.23 

1.17 

0.35 

10 

19 

30398 

B 

0 

18 

32 

0.97 

0.18 

1.33 

0.13 

10 

19 

30398 

C 

0 

11 

19 

0.29 

0.25 

0.72 

-0.24 

10 

19 

30398 

D 

0 

8 

14 

-0.15 

0.31 

0.46 

-0.38 

10 

20 

30084 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.04 

10 

20 

30084 

A 

1 

9 

16 

1.37 

0.35 

1.00 

0.28 

10 

20 

30084 

B 

0 

1 

2 

1.58 

0.00 

1.73 

0.12 

10 

20 

30084 

C 

0 

41 

75 

0.70 

0.15 

1.15 

-0.05 

10 

20 

30084 

D 

0 

4 

7 

-0.62 

0.08 

0.19 

-0.38 

10 

21 

30314 

* 

-1 

4938 

99 

1.22 

0.02 

0.00 

0.07 

10 

21 

30314 

A 

1 

44 

79 

0.58 

0.12 

0.86 

0.45 

10 

21 

30314 

B 

0 

5 

9 

-0.02 

0.62 

1.71 

-0.12 

10 

21 

30314 

C 

0 

5 

9 

-0.52 

0.11 

0.54 

-0.29 

10 

21 

30314 

D 

0 

2 

4 

-1.45 

0.37 

0.22 

-0.37 

10 

22 

30302 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.02 

10 

22 

30302 

A 

1 

46 

82 

1.16 

0.15 

0.97 

0.37 

10 

22 

30302 

B 

0 

5 

9 

0.02 

0.37 

0.64 

-0.29 

10 

22 

30302 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

22 

30302 

D 

0 

5 

9 

0.29 

0.34 

0.87 

-0.21 

10 

23 

30021 

* 

-1 

4932 

99 

1.21 

0.02 

0.00 

0.06 

10 

23 

30021 

A 

1 

43 

69 

0.76 

0.16 

1.12 

0.32 

10 

23 

30021 

B 

0 

18 

29 

0.10 

0.23 

1.12 

-0.24 

10 

23 

30021 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

23 

30021 

D 

0 

1 

2 

-2.12 

0.00 

0.09 

-0.30 

10 

24 

30042 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

10 

24 

30042 

A 

1 

32 

56 

1.32 

0.18 

0.86 

0.54 

10 

24 

30042 

B 

0 

10 

18 

0.13 

0.22 

0.69 

-0.29 

10 

24 

30042 

C 

0 

9 

16 

0.43 

0.26 

1.01 

-0.15 

10 

24 

30042 

D 

0 

6 

11 

-0.24 

0.35 

0.52 

-0.33 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

10 

25 

30632 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.06 

10 

25 

30632 

A 

1 

24 

43 

1.23 

0.33 

0.94 

0.47 

10 

25 

30632 

B 

0 

7 

13 

0.24 

0.20 

0.97 

-0.08 

10 

25 

30632 

C 

0 

10 

18 

-0.49 

0.24 

0.51 

-0.35 

10 

25 

30632 

D 

0 

15 

27 

0.13 

0.22 

1.12 

-0.17 

10 

26 

3OA620 

* 

-1 

4880 

98 

1.19 

0.02 

0.00 

-0.07 

10 

26 

3OA620 

A 

1 

65 

57 

2.24 

0.13 

0.92 

0.45 

10 

26 

3OA620 

B 

0 

19 

17 

0.87 

0.14 

0.53 

-0.38 

10 

26 

3OA620 

C 

0 

30 

26 

1.44 

0.18 

1.28 

-0.19 

10 

26 

3OA620 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

27 

30033 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.02 

10 

27 

30033 

A 

1 

16 

28 

1.83 

0.32 

0.95 

0.47 

10 

27 

30033 

B 

0 

16 

28 

0.74 

0.18 

0.89 

-0.14 

10 

27 

30033 

C 

0 

3 

5 

1.32 

0.34 

1.41 

0.07 

10 

27 

30033 

D 

0 

23 

40 

0.54 

0.20 

0.79 

-0.33 

10 

28 

3NBT124 

* 

-1 

4884 

98 

1.20 

0.02 

0.00 

-0.04 

10 

28 

3NBT124 

A 

1 

80 

73 

1.80 

0.14 

1.09 

0.33 

10 

28 

3NBT124 

B 

0 

14 

13 

1.05 

0.24 

1.16 

-0.16 

10 

28 

3NBT124 

C 

0 

16 

15 

0.78 

0.21 

0.85 

-0.27 

10 

28 

3NBT124 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

29 

3NBT12 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.11 

10 

29 

3NBT12 

A 

1 

85 

77 

2.44 

0.12 

0.90 

0.45 

10 

29 

3NBT12 

B 

0 

19 

17 

1.30 

0.13 

0.65 

-0.35 

10 

29 

3NBT12 

C 

0 

7 

6 

1.08 

0.46 

0.78 

-0.25 

10 

29 

3NBT12 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

30 

3NBT215 

* 

-1 

4888 

98 

1.20 

0.02 

0.00 

-0.04 

10 

30 

3NBT215 

A 

1 

60 

57 

2.04 

0.14 

1.06 

0.41 

10 

30 

3NBT215 

B 

0 

32 

30 

1.27 

0.21 

1.87 

-0.19 

10 

30 

3NBT215 

C 

0 

14 

13 

0.59 

0.22 

0.55 

-0.34 

10 

30 

3NBT215 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMF 

1 

3NF29 

* 

-1 

4888 

98 

1.19 

0.02 

0.00 

-0.07 

BMF 

1 

3NF29 

A 

1 

98 

92 

1.88 

0.10 

0.98 

0.26 

BMF 

1 

3NF29 

B 

0 

5 

5 

0.92 

0.72 

1.44 

-0.19 

BMF 

1 

3NF29 

C 

0 

3 

3 

0.68 

0.45 

0.61 

-0.18 

BMF 

1 

3NF29 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

2 

3NF274 

* 

-1 

4872 

98 

1.18 

0.02 

0.00 

-0.12 

BMF 

2 

3NF274 

A 

1 

91 

75 

2.40 

0.12 

1.08 

0.30 

BMF 

2 

3NF274 

B 

0 

24 

20 

1.89 

0.18 

1.41 

-0.14 

BMF 

2 

3NF274 

C 

0 

7 

6 

0.77 

0.42 

0.52 

-0.31 

BMF 

2 

3NF274 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

3 

3NF317 

* 

-1 

4888 

98 

1.20 

0.02 

0.00 

-0.04 

BMF 

3 

3NF317 

A 

1 

56 

53 

2.23 

0.15 

0.88 

0.55 

BMF 

3 

3NF317 

B 

0 

16 

15 

0.82 

0.29 

0.86 

-0.28 

BMF 

3 

3NF317 

C 

0 

34 

32 

0.97 

0.12 

0.71 

-0.37 

BMF 

3 

3NF317 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

4 

3MD211 

* 

-1 

4877 

98 

1.19 

0.02 

0.00 

-0.07 

BMF 

4 

3MD211 

A 

1 

107 

91 

1.95 

0.09 

0.93 

0.40 

BMF 

4 

3MD211 

B 

0 

6 

5 

0.68 

0.32 

0.64 

-0.25 

BMF 

4 

3MD211 

C 

0 

4 

3 

0.12 

0.55 

0.45 

-0.31 

BMF 

4 

3MD211 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

5 

3MD26 

* 

-1 

4877 

98 

1.19 

0.02 

0.00 

-0.07 

BMF 

5 

3MD26 

A 

1 

80 

68 

2.21 

0.13 

0.91 

0.49 

BMF 

5 

3MD26 

B 

0 

16 

14 

0.77 

0.14 

0.52 

-0.36 

BMF 

5 

3MD26 

C 

0 

21 

18 

1.13 

0.17 

0.85 

-0.28 

BMF 

5 

3MD26 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

Note.  BMF  = Benchmark  Fall. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMF 

6 

3MD113 

* 

-1 

4865 

97 

1.19 

0.02 

0.00 

-0.09 

BMF 

6 

3MD113 

A 

1 

75 

58 

2.44 

0.13 

0.87 

0.50 

BMF 

6 

3MD113 

B 

0 

34 

26 

0.95 

0.17 

0.74 

-0.46 

BMF 

6 

3MD113 

C 

0 

20 

16 

1.56 

0.25 

1.37 

-0.12 

BMF 

6 

3MD113 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

7 

30412 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.03 

BMF 

7 

30412 

A 

1 

52 

90 

0.93 

0.15 

1.06 

0.17 

BMF 

7 

30412 

B 

0 

2 

3 

1.09 

0.97 

2.87 

0.04 

BMF 

7 

30412 

C 

0 

3 

5 

0.29 

0.15 

0.87 

-0.13 

BMF 

7 

30412 

D 

0 

1 

2 

-1.06 

0.00 

0.22 

-0.24 

BMF 

8 

30402 

* 

-1 

4955 

99 

1.21 

0.02 

0.00 

0.02 

BMF 

8 

30402 

A 

1 

33 

85 

1.20 

0.23 

0.83 

0.45 

BMF 

8 

30402 

B 

0 

5 

13 

-0.35 

0.38 

0.60 

-0.35 

BMF 

8 

30402 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

8 

30402 

D 

0 

1 

3 

-1.42 

0.00 

0.16 

-0.27 

BMF 

9 

3G119 

* 

-1 

4769 

95 

1.17 

0.02 

0.00 

-0.11 

BMF 

9 

3G119 

A 

1 

202 

90 

2.00 

0.07 

0.92 

0.37 

BMF 

9 

3G119 

B 

0 

18 

8 

0.81 

0.19 

0.70 

-0.29 

BMF 

9 

3G119 

C 

0 

5 

2 

0.31 

0.45 

0.45 

-0.22 

BMF 

9 

3G119 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

10 

31016 

* 

-1 

4946 

99 

1.21 

0.02 

0.00 

0.01 

BMF 

10 

31016 

A 

1 

37 

77 

1.31 

0.19 

1.09 

0.31 

BMF 

10 

31016 

B 

0 

2 

4 

0.14 

0.15 

0.50 

-0.19 

BMF 

10 

31016 

C 

0 

3 

6 

1.06 

0.79 

2.42 

-0.01 

BMF 

10 

31016 

D 

0 

6 

13 

0.35 

0.19 

0.68 

-0.27 

Note.  BMF  = Benchmark  Fall. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMF 

11 

3G135 

* 

-1 

4873 

98 

1.19 

0.02 

0.00 

-0.09 

BMF 

11 

3G135 

A 

1 

95 

79 

2.21 

0.13 

0.99 

0.36 

BMF 

11 

3G135 

B 

0 

18 

15 

1.30 

0.13 

0.85 

-0.23 

BMF 

11 

3G135 

C 

0 

8 

7 

0.75 

0.27 

0.55 

-0.27 

BMF 

11 

3G135 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

12 

31197 

* 

-1 

4958 

99 

1.21 

0.02 

0.00 

0.02 

BMF 

12 

31197 

A 

1 

18 

50 

0.93 

0.22 

1.43 

0.10 

BMF 

12 

31197 

B 

0 

14 

39 

0.82 

0.28 

1.49 

-0.02 

BMF 

12 

31197 

C 

0 

4 

11 

0.49 

0.55 

0.94 

-0.13 

BMF 

12 

31197 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

13 

30861 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

BMF 

13 

30861 

A 

1 

20 

35 

1.10 

0.31 

1.51 

0.18 

BMF 

13 

30861 

B 

0 

2 

4 

1.58 

0.07 

2.04 

0.13 

BMF 

13 

30861 

C 

0 

31 

54 

0.77 

0.14 

1.25 

-0.06 

BMF 

13 

30861 

D 

0 

4 

7 

-0.42 

0.70 

0.47 

-0.31 

BMF 

14 

30509 

* 

-1 

4601 

92 

1.14 

0.02 

0.00 

-0.17 

BMF 

14 

30509 

A 

1 

368 

94 

2.08 

0.07 

1.00 

0.31 

BMF 

14 

30509 

B 

0 

9 

2 

0.28 

0.26 

0.48 

-0.19 

BMF 

14 

30509 

C 

0 

15 

4 

0.45 

0.31 

0.98 

-0.22 

BMF 

14 

30509 

D 

0 

1 

0 

-0.93 

0.00 

0.11 

-0.10 

BMF 

15 

30054 

* 

-1 

4944 

99 

1.21 

0.02 

0.00 

0.02 

BMF 

15 

30054 

A 

1 

43 

86 

1.02 

0.14 

1.04 

0.28 

BMF 

15 

30054 

B 

0 

6 

12 

0.49 

0.27 

1.08 

-0.17 

BMF 

15 

30054 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

15 

30054 

D 

0 

1 

2 

-0.89 

0.00 

0.22 

-0.28 

Note.  BMF  = Benchmark  Fall. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMF 

16 

30360 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.04 

BMF 

16 

30360 

A 

1 

43 

78 

0.86 

0.14 

1.03 

0.20 

BMF 

16 

30360 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

16 

30360 

C 

0 

4 

7 

1.09 

0.33 

1.99 

0.10 

BMF 

16 

30360 

D 

0 

8 

15 

0.06 

0.27 

0.80 

-0.31 

BMF 

17 

30841 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

BMF 

17 

30841 

A 

1 

39 

68 

0.97 

0.13 

0.96 

0.48 

BMF 

17 

30841 

B 

0 

5 

9 

0.19 

0.21 

0.76 

-0.17 

BMF 

17 

30841 

C 

0 

4 

7 

-0.34 

0.33 

0.47 

-0.32 

BMF 

17 

30841 

D 

0 

9 

16 

0.18 

0.25 

0.94 

-0.25 

BMF 

18 

30223 

* 

-1 

4936 

99 

1.22 

0.02 

0.00 

0.07 

BMF 

18 

30223 

A 

1 

31 

53 

0.78 

0.18 

1.04 

0.39 

BMF 

18 

30223 

B 

0 

7 

12 

-0.26 

0.42 

0.88 

-0.20 

BMF 

18 

30223 

C 

0 

12 

21 

-0.11 

0.35 

1.13 

-0.21 

BMF 

18 

30223 

D 

0 

8 

14 

-0.01 

0.45 

1.19 

-0.13 

BMF 

19 

30991 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

BMF 

19 

30991 

A 

1 

23 

41 

1.39 

0.16 

0.81 

0.50 

BMF 

19 

30991 

B 

0 

14 

25 

0.34 

0.27 

0.89 

-0.20 

BMF 

19 

30991 

C 

0 

5 

9 

1.12 

0.12 

1.34 

0.11 

BMF 

19 

30991 

D 

0 

14 

25 

-0.13 

0.32 

0.64 

-0.44 

BMF 

20 

30231 

* 

-1 

4942 

99 

1.21 

0.02 

0.00 

0.02 

BMF 

20 

30231 

A 

1 

7 

13 

1.54 

0.37 

1.19 

0.24 

BMF 

20 

30231 

B 

0 

4 

8 

0.03 

0.77 

0.81 

-0.27 

BMF 

20 

30231 

C 

0 

39 

75 

0.92 

0.14 

1.03 

-0.06 

BMF 

20 

30231 

D 

0 

2 

4 

1.39 

0.74 

1.47 

0.09 

Note.  BMF  = Benchmark  Fall. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMF 

21 

30152 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

BMF 

21 

30152 

A 

1 

47 

82 

0.89 

0.17 

0.95 

0.38 

BMF 

21 

30152 

B 

0 

2 

4 

-1.05 

0.13 

0.27 

-0.28 

BMF 

21 

30152 

C 

0 

5 

9 

-0.23 

0.51 

1.05 

-0.24 

BMF 

21 

30152 

D 

0 

3 

5 

0.05 

0.15 

0.82 

-0.12 

BMF 

22 

30319 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

BMF 

22 

30319 

A 

1 

45 

79 

1.00 

0.15 

0.90 

0.49 

BMF 

22 

30319 

B 

0 

5 

9 

-0.20 

0.33 

0.67 

-0.27 

BMF 

22 

30319 

C 

0 

1 

2 

-0.61 

0.00 

0.36 

-0.17 

BMF 

22 

30319 

D 

0 

6 

11 

-0.33 

0.39 

0.68 

-0.34 

BMF 

23 

30315 

* 

-1 

4942 

99 

1.21 

0.02 

0.00 

0.04 

BMF 

23 

30315 

A 

1 

37 

71 

1.01 

0.16 

0.85 

0.49 

BMF 

23 

30315 

B 

0 

5 

10 

0.35 

0.32 

1.11 

-0.08 

BMF 

23 

30315 

C 

0 

1 

2 

-0.20 

0.00 

0.54 

-0.10 

BMF 

23 

30315 

D 

0 

9 

17 

-0.58 

0.40 

0.66 

-0.49 

BMF 

24 

30A516 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.08 

BMF 

24 

30A516 

A 

1 

89 

77 

2.22 

0.11 

0.88 

0.47 

BMF 

24 

30A516 

B 

0 

16 

14 

0.81 

0.18 

0.55 

-0.42 

BMF 

24 

30A516 

C 

0 

11 

9 

1.35 

0.18 

0.86 

-0.18 

BMF 

24 

30A516 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

25 

30784 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.04 

BMF 

25 

30784 

A 

1 

27 

50 

1.31 

0.18 

0.76 

0.54 

BMF 

25 

30784 

B 

0 

5 

9 

0.27 

0.38 

0.88 

-0.14 

BMF 

25 

30784 

C 

0 

4 

7 

0.31 

0.27 

0.74 

-0.11 

BMF 

25 

30784 

D 

0 

18 

33 

0.10 

0.23 

0.81 

-0.43 

Note.  BMF  = Benchmark  Fall. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMF 

26 

30931 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.05 

BMF 

26 

30931 

A 

1 

21 

36 

1.41 

0.29 

1.07 

0.50 

BMF 

26 

30931 

B 

0 

12 

20 

-0.01 

0.23 

0.62 

-0.29 

BMF 

26 

30931 

C 

0 

15 

25 

0.57 

0.19 

1.06 

-0.04 

BMF 

26 

30931 

D 

0 

11 

19 

0.00 

0.21 

0.59 

-0.27 

BMF 

27 

30470 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.05 

BMF 

27 

30470 

A 

1 

10 

18 

1.38 

0.35 

1.05 

0.35 

BMF 

27 

30470 

B 

0 

14 

25 

0.64 

0.26 

1.09 

0.01 

BMF 

27 

30470 

C 

0 

5 

9 

0.91 

0.42 

1.50 

0.09 

BMF 

27 

30470 

D 

0 

27 

48 

0.28 

0.18 

0.77 

-0.32 

BMF 

28 

3NBT13 

* 

-1 

4877 

98 

1.19 

0.02 

0.00 

-0.07 

BMF 

28 

3NBT13 

A 

1 

91 

78 

2.11 

0.12 

0.90 

0.47 

BMF 

28 

3NBT13 

B 

0 

9 

8 

0.90 

0.26 

0.72 

-0.23 

BMF 

28 

3NBT13 

C 

0 

17 

15 

0.73 

0.13 

0.55 

-0.39 

BMF 

28 

3NBT13 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

29 

3NBT121 

* 

-1 

4876 

98 

1.18 

0.02 

0.00 

-0.11 

BMF 

29 

3NBT121 

A 

1 

85 

72 

2.36 

0.15 

1.28 

0.29 

BMF 

29 

3NBT121 

B 

0 

22 

19 

1.69 

0.24 

1.97 

-0.15 

BMF 

29 

3NBT121 

C 

0 

11 

9 

1.10 

0.25 

0.68 

-0.25 

BMF 

29 

3NBT121 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

30 

3NBT17 

* 

-1 

4886 

98 

1.19 

0.02 

0.00 

-0.07 

BMF 

30 

3NBT17 

A 

1 

70 

65 

2.10 

0.12 

1.15 

0.38 

BMF 

30 

3NBT17 

B 

0 

32 

30 

1.40 

0.15 

1.05 

-0.25 

BMF 

30 

3NBT17 

C 

0 

6 

6 

0.50 

0.32 

0.37 

-0.30 

BMF 

30 

3NBT17 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

Note.  BMF  = Benchmark  Fall. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMF 

31 

41093 

* 

-1 

4838 

99 

1.00 

0.02 

0.00 

0.02 

BMF 

31 

41093 

A 

1 

36 

78 

1.12 

0.17 

0.79 

0.61 

BMF 

31 

41093 

B 

0 

2 

4 

-0.87 

0.45 

0.31 

-0.29 

BMF 

31 

41093 

C 

0 

4 

9 

-0.21 

0.32 

0.64 

-0.25 

BMF 

31 

41093 

D 

0 

4 

9 

-0.93 

0.28 

0.30 

-0.43 

BMF 

32 

40A416 

* 

-1 

4765 

98 

0.98 

0.02 

0.00 

-0.08 

BMF 

32 

40A416 

A 

1 

99 

83 

1.87 

0.12 

0.87 

0.46 

BMF 

32 

40A416 

B 

0 

6 

5 

0.33 

0.34 

0.56 

-0.23 

BMF 

32 

40A416 

C 

0 

14 

12 

0.32 

0.19 

0.53 

-0.37 

BMF 

32 

40A416 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

33 

4G330 

* 

-1 

4795 

98 

0.99 

0.02 

0.00 

-0.06 

BMF 

33 

4G330 

A 

1 

65 

73 

1.84 

0.12 

0.95 

0.40 

BMF 

33 

4G330 

B 

0 

17 

19 

1.17 

0.17 

0.98 

-0.22 

BMF 

33 

4G330 

C 

0 

7 

8 

0.50 

0.17 

0.43 

-0.34 

BMF 

33 

4G330 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

34 

40A29 

* 

-1 

4792 

98 

0.99 

0.02 

0.00 

-0.06 

BMF 

34 

40A29 

A 

1 

57 

62 

1.96 

0.11 

0.82 

0.51 

BMF 

34 

40A29 

B 

0 

11 

12 

0.78 

0.17 

0.60 

-0.31 

BMF 

34 

40A29 

C 

0 

24 

26 

1.04 

0.17 

0.95 

-0.34 

BMF 

34 

40A29 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

35 

40A57 

* 

-1 

4795 

98 

0.98 

0.02 

0.00 

-0.09 

BMF 

35 

40A57 

A 

1 

50 

56 

2.21 

0.13 

0.99 

0.42 

BMF 

35 

40A57 

B 

0 

9 

10 

1.28 

0.23 

0.74 

-0.21 

BMF 

35 

40A57 

C 

0 

30 

34 

1.48 

0.12 

0.89 

-0.31 

BMF 

35 

40A57 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

Note.  BMF  = Benchmark  Fall. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMF 

36 

2G335 

* 

-1 

3908 

98 

1.51 

0.02 

0.00 

-0.01 

BMF 

36 

2G335 

A 

1 

75 

89 

1.73 

0.13 

0.90 

0.38 

BMF 

36 

2G335 

B 

0 

8 

10 

0.25 

0.34 

0.66 

-0.37 

BMF 

36 

2G335 

C 

0 

1 

1 

0.86 

0.00 

0.76 

-0.07 

BMF 

36 

2G335 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

37 

23158 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

BMF 

37 

23158 

A 

1 

37 

82 

2.06 

0.25 

0.77 

0.52 

BMF 

37 

23158 

B 

0 

6 

13 

0.13 

0.38 

0.70 

-0.36 

BMF 

37 

23158 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

37 

23158 

D 

0 

2 

4 

-1.05 

0.38 

0.16 

-0.35 

BMF 

38 

22183 

* 

-1 

1471 

37 

1.65 

0.03 

0.00 

0.07 

BMF 

38 

22183 

A 

1 

1723 

68 

1.97 

0.03 

0.99 

0.51 

BMF 

38 

22183 

B 

0 

174 

7 

0.17 

0.08 

0.81 

-0.23 

BMF 

38 

22183 

C 

0 

208 

8 

0.49 

0.08 

0.99 

-0.19 

BMF 

38 

22183 

D 

0 

416 

17 

0.26 

0.06 

0.83 

-0.34 

BMF 

39 

2NBT67 

* 

-1 

3907 

98 

1.51 

0.02 

0.00 

-0.01 

BMF 

39 

2NBT67 

A 

1 

56 

66 

1.99 

0.15 

0.95 

0.47 

BMF 

39 

2NBT67 

B 

0 

10 

12 

0.73 

0.23 

0.63 

-0.28 

BMF 

39 

2NBT67 

C 

0 

19 

22 

0.94 

0.19 

0.87 

-0.32 

BMF 

39 

2NBT67 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

40 

22344 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

BMF 

40 

22344 

A 

1 

19 

43 

2.28 

0.34 

0.72 

0.61 

BMF 

40 

22344 

B 

0 

5 

11 

0.84 

0.19 

0.77 

-0.13 

BMF 

40 

22344 

C 

0 

11 

25 

0.48 

0.28 

0.70 

-0.35 

BMF 

40 

22344 

D 

0 

9 

20 

0.59 

0.15 

0.62 

-0.27 

Note.  BMF  = Benchmark  Fall. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMW 

1 

3NF26 

* 

-1 

4871 

98 

1.18 

0.02 

0.00 

-0.12 

BMW 

1 

3NF26 

A 

1 

116 

94 

2.30 

0.10 

0.95 

0.33 

BMW 

1 

3NF26 

B 

0 

5 

4 

0.94 

0.41 

0.68 

-0.23 

BMW 

1 

3NF26 

C 

0 

2 

2 

0.15 

0.14 

0.21 

-0.24 

BMW 

1 

3NF26 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

2 

3NF274 

* 

-1 

4872 

98 

1.18 

0.02 

0.00 

-0.12 

BMW 

2 

3NF274 

A 

1 

91 

75 

2.40 

0.12 

1.08 

0.30 

BMW 

2 

3NF274 

B 

0 

24 

20 

1.89 

0.18 

1.41 

-0.14 

BMW 

2 

3NF274 

C 

0 

7 

6 

0.77 

0.42 

0.52 

-0.31 

BMW 

2 

3NF274 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

3 

3NF265 

* 

-1 

4874 

98 

1.19 

0.02 

0.00 

-0.09 

BMW 

3 

3NF265 

A 

1 

71 

59 

2.41 

0.15 

0.97 

0.44 

BMW 

3 

3NF265 

B 

0 

32 

27 

1.49 

0.16 

1.15 

-0.24 

BMW 

3 

3NF265 

C 

0 

17 

14 

1.03 

0.14 

0.55 

-0.31 

BMW 

3 

3NF265 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

4 

3MD59 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.08 

BMW 

4 

3MD59 

A 

1 

107 

92 

2.03 

0.10 

0.96 

0.29 

BMW 

4 

3MD59 

B 

0 

2 

2 

0.49 

0.00 

0.35 

-0.18 

BMW 

4 

3MD59 

C 

0 

7 

6 

0.96 

0.31 

0.76 

-0.23 

BMW 

4 

3MD59 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

5 

3MD87 

* 

-1 

4887 

98 

1.18 

0.02 

0.00 

-0.11 

BMW 

5 

3MD87 

A 

1 

78 

73 

2.60 

0.17 

1.16 

0.41 

BMW 

5 

3MD87 

B 

0 

14 

13 

1.31 

0.29 

1.13 

-0.24 

BMW 

5 

3MD87 

C 

0 

15 

14 

1.10 

0.30 

0.87 

-0.30 

BMW 

5 

3MD87 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

Note.  BMW  = Benchmark  Winter. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

Item  ID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMW 

6 

3MD16 

* 

-1 

4774 

96 

1.18 

0.02 

0.00 

-0.07 

BMW 

6 

3MD16 

A 

1 

118 

54 

2.08 

0.10 

1.18 

0.39 

BMW 

6 

3MD16 

B 

0 

49 

22 

1.41 

0.13 

1.19 

-0.12 

BMW 

6 

3MD16 

C 

0 

53 

24 

1.01 

0.14 

1.07 

-0.33 

BMW 

6 

3MD16 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

7 

30413 

* 

-1 

4952 

99 

1.21 

0.02 

0.00 

0.02 

BMW 

7 

30413 

A 

1 

38 

90 

1.00 

0.18 

1.00 

0.26 

BMW 

7 

30413 

B 

0 

2 

5 

0.17 

0.23 

0.72 

-0.16 

BMW 

7 

30413 

C 

0 

2 

5 

-0.08 

0.43 

0.59 

-0.21 

BMW 

7 

30413 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

8 

30871 

* 

-1 

4953 

99 

1.21 

0.02 

0.00 

0.02 

BMW 

8 

30871 

A 

1 

36 

88 

1.01 

0.16 

1.08 

0.08 

BMW 

8 

30871 

B 

0 

2 

5 

0.56 

0.52 

0.99 

-0.10 

BMW 

8 

30871 

C 

0 

2 

5 

0.73 

0.75 

1.33 

-0.06 

BMW 

8 

30871 

D 

0 

1 

2 

1.26 

0.00 

1.75 

0.05 

BMW 

9 

3G17 

* 

-1 

4886 

98 

1.18 

0.02 

0.00 

-0.11 

BMW 

9 

3G17 

A 

1 

97 

90 

2.35 

0.15 

1.07 

0.26 

BMW 

9 

3G17 

B 

0 

9 

8 

1.12 

0.35 

1.15 

-0.22 

BMW 

9 

3G17 

C 

0 

2 

2 

0.84 

1.77 

1.71 

-0.13 

BMW 

9 

3G17 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

10 

31184 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

BMW 

10 

31184 

A 

1 

40 

71 

1.02 

0.22 

1.65 

0.25 

BMW 

10 

31184 

B 

0 

6 

11 

0.36 

0.54 

1.40 

-0.12 

BMW 

10 

31184 

C 

0 

4 

7 

0.17 

0.59 

1.23 

-0.14 

BMW 

10 

31184 

D 

0 

6 

11 

0.30 

0.39 

1.13 

-0.13 

Note.  BMW  = Benchmark  Winter. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMW 

11 

3G135 

* 

-1 

4873 

98 

1.19 

0.02 

0.00 

-0.09 

BMW 

11 

3G135 

A 

1 

95 

79 

2.21 

0.13 

0.99 

0.36 

BMW 

11 

3G135 

B 

0 

18 

15 

1.30 

0.13 

0.85 

-0.23 

BMW 

11 

3G135 

C 

0 

8 

7 

0.75 

0.27 

0.55 

-0.27 

BMW 

11 

3G135 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

12 

3G117 

* 

-1 

4881 

98 

1.18 

0.02 

0.00 

-0.12 

BMW 

12 

3G117 

A 

1 

85 

75 

2.66 

0.12 

0.87 

0.50 

BMW 

12 

3G117 

B 

0 

11 

10 

1.17 

0.26 

0.64 

-0.30 

BMW 

12 

3G117 

C 

0 

17 

15 

1.24 

0.22 

0.72 

-0.36 

BMW 

12 

3G117 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

13 

31190 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

BMW 

13 

31190 

A 

1 

20 

35 

1.36 

0.31 

1.55 

0.35 

BMW 

13 

31190 

B 

0 

15 

26 

0.76 

0.25 

1.30 

0.01 

BMW 

13 

31190 

C 

0 

7 

12 

0.43 

0.61 

1.49 

-0.09 

BMW 

13 

31190 

D 

0 

15 

26 

0.06 

0.22 

0.58 

-0.32 

BMW 

14 

30509 

* 

-1 

4601 

92 

1.14 

0.02 

0.00 

-0.17 

BMW 

14 

30509 

A 

1 

368 

94 

2.08 

0.07 

1.00 

0.31 

BMW 

14 

30509 

B 

0 

9 

2 

0.28 

0.26 

0.48 

-0.19 

BMW 

14 

30509 

C 

0 

15 

4 

0.45 

0.31 

0.98 

-0.22 

BMW 

14 

30509 

D 

0 

1 

0 

-0.93 

0.00 

0.11 

-0.10 

BMW 

15 

30236 

* 

-1 

4933 

99 

1.21 

0.02 

0.00 

0.06 

BMW 

15 

30236 

A 

1 

49 

80 

0.76 

0.14 

0.85 

0.45 

BMW 

15 

30236 

B 

0 

8 

13 

-0.94 

0.25 

0.38 

-0.53 

BMW 

15 

30236 

C 

0 

3 

5 

0.47 

0.60 

1.76 

-0.01 

BMW 

15 

30236 

D 

0 

1 

2 

0.80 

0.00 

1.77 

0.03 

Note.  BMW  = Benchmark  Winter. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMW 

16 

30388 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

BMW 

16 

30388 

A 

1 

42 

75 

0.91 

0.19 

1.07 

0.33 

BMW 

16 

30388 

B 

0 

6 

11 

0.90 

0.20 

1.97 

0.06 

BMW 

16 

30388 

C 

0 

2 

4 

-0.45 

0.50 

0.52 

-0.17 

BMW 

16 

30388 

D 

0 

6 

11 

-0.81 

0.37 

0.44 

-0.41 

BMW 

17 

30841 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

BMW 

17 

30841 

A 

1 

39 

68 

0.97 

0.13 

0.96 

0.48 

BMW 

17 

30841 

B 

0 

5 

9 

0.19 

0.21 

0.76 

-0.17 

BMW 

17 

30841 

C 

0 

4 

7 

-0.34 

0.33 

0.47 

-0.32 

BMW 

17 

30841 

D 

0 

9 

16 

0.18 

0.25 

0.94 

-0.25 

BMW 

18 

30684 

* 

-1 

4931 

99 

1.21 

0.02 

0.00 

0.02 

BMW 

18 

30684 

A 

1 

41 

65 

1.22 

0.14 

1.00 

0.39 

BMW 

18 

30684 

B 

0 

6 

10 

0.48 

0.42 

1.01 

-0.16 

BMW 

18 

30684 

C 

0 

10 

16 

0.45 

0.30 

0.93 

-0.22 

BMW 

18 

30684 

D 

0 

6 

10 

0.37 

0.47 

1.10 

-0.19 

BMW 

19 

30091 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.03 

BMW 

19 

30091 

A 

1 

23 

40 

1.43 

0.29 

1.21 

0.44 

BMW 

19 

30091 

B 

0 

3 

5 

-0.57 

0.34 

0.28 

-0.27 

BMW 

19 

30091 

C 

0 

12 

21 

0.43 

0.21 

0.90 

-0.16 

BMW 

19 

30091 

D 

0 

20 

34 

0.49 

0.18 

0.94 

-0.19 

BMW 

20 

30681 

* 

-1 

4928 

99 

1.21 

0.02 

0.00 

0.02 

BMW 

20 

30681 

A 

1 

10 

15 

2.08 

0.32 

0.86 

0.39 

BMW 

20 

30681 

B 

0 

17 

26 

1.39 

0.21 

1.40 

0.20 

BMW 

20 

30681 

C 

0 

29 

44 

0.64 

0.20 

0.81 

-0.25 

BMW 

20 

30681 

D 

0 

10 

15 

0.15 

0.45 

0.50 

-0.29 

Note.  BMW  = Benchmark  Winter. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMW 

21 

30200 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.02 

BMW 

21 

30200 

A 

1 

47 

85 

1.04 

0.15 

1.04 

0.33 

BMW 

21 

30200 

B 

0 

2 

4 

-0.15 

0.09 

0.51 

-0.19 

BMW 

21 

30200 

C 

0 

3 

5 

0.10 

0.00 

0.65 

-0.18 

BMW 

21 

30200 

D 

0 

3 

5 

0.11 

1.05 

1.95 

-0.17 

BMW 

22 

30911 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.03 

BMW 

22 

30911 

A 

1 

44 

81 

0.91 

0.15 

1.08 

0.18 

BMW 

22 

30911 

B 

0 

1 

2 

0.55 

0.00 

0.96 

-0.04 

BMW 

22 

30911 

C 

0 

2 

4 

0.22 

0.51 

0.78 

-0.13 

BMW 

22 

30911 

D 

0 

7 

13 

0.54 

0.30 

1.14 

-0.12 

BMW 

23 

30342 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.05 

BMW 

23 

30342 

A 

1 

42 

70 

0.90 

0.14 

0.84 

0.54 

BMW 

23 

30342 

B 

0 

6 

10 

-0.67 

0.34 

0.45 

-0.40 

BMW 

23 

30342 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

23 

30342 

D 

0 

12 

20 

-0.10 

0.14 

0.70 

-0.32 

BMW 

24 

30A43 

* 

-1 

4887 

98 

1.18 

0.02 

0.00 

-0.11 

BMW 

24 

30A43 

A 

1 

83 

78 

2.67 

0.15 

0.88 

0.55 

BMW 

24 

30A43 

B 

0 

9 

8 

0.45 

0.31 

0.43 

-0.36 

BMW 

24 

30A43 

C 

0 

15 

14 

0.82 

0.22 

0.62 

-0.38 

BMW 

24 

30A43 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

25 

30785 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.02 

BMW 

25 

30785 

A 

1 

30 

54 

1.47 

0.19 

0.78 

0.50 

BMW 

25 

30785 

B 

0 

7 

13 

0.51 

0.34 

0.97 

-0.12 

BMW 

25 

30785 

C 

0 

11 

20 

0.57 

0.19 

0.90 

-0.13 

BMW 

25 

30785 

D 

0 

8 

14 

-0.49 

0.56 

0.46 

-0.45 

Note.  BMW  = Benchmark  Winter. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMW 

26 

30A63 

* 

-1 

4872 

98 

1.18 

0.02 

0.00 

-0.12 

BMW 

26 

30A63 

A 

1 

81 

66 

2.53 

0.11 

0.96 

0.40 

BMW 

26 

30A63 

B 

0 

37 

30 

1.64 

0.18 

1.48 

-0.33 

BMW 

26 

30A63 

C 

0 

4 

3 

0.88 

0.42 

0.40 

-0.22 

BMW 

26 

30A63 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

27 

30794 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.05 

BMW 

27 

30794 

A 

1 

11 

19 

1.27 

0.30 

1.07 

0.31 

BMW 

27 

30794 

B 

0 

6 

10 

0.25 

0.10 

0.52 

-0.13 

BMW 

27 

30794 

C 

0 

38 

64 

0.58 

0.17 

1.11 

-0.08 

BMW 

27 

30794 

D 

0 

4 

7 

0.05 

0.28 

0.47 

-0.16 

BMW 

28 

3NBT229 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.12 

BMW 

28 

3NBT229 

A 

1 

93 

84 

2.53 

0.12 

0.92 

0.41 

BMW 

28 

3NBT229 

B 

0 

11 

10 

1.21 

0.25 

0.72 

-0.30 

BMW 

28 

3NBT229 

C 

0 

7 

6 

1.06 

0.42 

0.76 

-0.26 

BMW 

28 

3NBT229 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

29 

3NBT323 

* 

-1 

4887 

98 

1.18 

0.02 

0.00 

-0.11 

BMW 

29 

3NBT323 

A 

1 

78 

73 

2.76 

0.15 

0.84 

0.58 

BMW 

29 

3NBT323 

B 

0 

15 

14 

0.64 

0.21 

0.44 

-0.42 

BMW 

29 

3NBT323 

C 

0 

14 

13 

0.93 

0.28 

0.75 

-0.33 

BMW 

29 

3NBT323 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

30 

3NBT325 

* 

-1 

4875 

98 

1.19 

0.02 

0.00 

-0.10 

BMW 

30 

3NBT325 

A 

1 

81 

68 

2.41 

0.14 

1.09 

0.41 

BMW 

30 

3NBT325 

B 

0 

16 

13 

1.35 

0.24 

0.93 

-0.22 

BMW 

30 

3NBT325 

C 

0 

22 

18 

1.26 

0.17 

0.78 

-0.30 

BMW 

30 

3NBT325 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

Note.  BMW  = Benchmark  Winter. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMW 

31 

40297 

* 

-1 

4824 

99 

1.00 

0.02 

0.00 

0.01 

BMW 

31 

40297 

A 

1 

47 

78 

1.23 

0.20 

0.95 

0.51 

BMW 

31 

40297 

B 

0 

12 

20 

-0.49 

0.30 

0.64 

-0.45 

BMW 

31 

40297 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

31 

40297 

D 

0 

1 

2 

-1.78 

0.00 

0.12 

-0.23 

BMW 

32 

40A412 

* 

-1 

4795 

98 

0.99 

0.02 

0.00 

-0.05 

BMW 

32 

40A412 

A 

1 

74 

83 

1.60 

0.12 

0.97 

0.32 

BMW 

32 

40A412 

B 

0 

9 

10 

0.86 

0.18 

0.85 

-0.20 

BMW 

32 

40A412 

C 

0 

6 

7 

0.56 

0.17 

0.58 

-0.24 

BMW 

32 

40A412 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

33 

4G119 

* 

-1 

4771 

98 

0.99 

0.02 

0.00 

-0.06 

BMW 

33 

4G119 

A 

1 

82 

73 

1.54 

0.11 

1.33 

0.01 

BMW 

33 

4G119 

B 

0 

6 

5 

1.48 

0.32 

1.51 

-0.02 

BMW 

33 

4G119 

C 

0 

25 

22 

1.52 

0.14 

1.57 

-0.01 

BMW 

33 

4G119 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

34 

40A124 

* 

-1 

4778 

98 

0.98 

0.02 

0.00 

-0.08 

BMW 

34 

40A124 

A 

1 

66 

62 

2.01 

0.14 

0.95 

0.40 

BMW 

34 

40A124 

B 

0 

16 

15 

1.03 

0.20 

0.89 

-0.24 

BMW 

34 

40A124 

C 

0 

24 

23 

1.14 

0.16 

0.94 

-0.26 

BMW 

34 

40A124 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

35 

40A311 

* 

-1 

4794 

98 

1.00 

0.02 

0.00 

-0.01 

BMW 

35 

40A311 

A 

1 

36 

40 

1.41 

0.18 

1.24 

0.27 

BMW 

35 

40A311 

B 

0 

16 

18 

0.88 

0.22 

1.13 

-0.10 

BMW 

35 

40A311 

C 

0 

38 

42 

0.88 

0.12 

1.18 

-0.19 

BMW 

35 

40A311 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

Note.  BMW  = Benchmark  Winter. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMW 

36 

2G18 

* 

-1 

3918 

98 

1.52 

0.02 

0.00 

0.01 

BMW 

36 

2G18 

A 

1 

65 

88 

1.46 

0.15 

1.15 

0.13 

BMW 

36 

2G18 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

36 

2G18 

C 

0 

9 

12 

0.99 

0.21 

1.26 

-0.13 

BMW 

36 

2G18 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

37 

23057 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

BMW 

37 

23057 

A 

1 

36 

82 

1.79 

0.17 

0.73 

0.61 

BMW 

37 

23057 

B 

0 

2 

5 

-0.79 

0.52 

0.19 

-0.38 

BMW 

37 

23057 

C 

0 

5 

11 

0.19 

0.54 

0.88 

-0.35 

BMW 

37 

23057 

D 

0 

1 

2 

-1.06 

0.00 

0.13 

-0.30 

BMW 

38 

22215 

* 

-1 

3949 

99 

1.52 

0.02 

0.00 

0.01 

BMW 

38 

22215 

A 

1 

29 

67 

1.97 

0.27 

0.85 

0.48 

BMW 

38 

22215 

B 

0 

6 

14 

0.28 

0.36 

0.70 

-0.30 

BMW 

38 

22215 

C 

0 

1 

2 

-0.03 

0.00 

0.37 

-0.14 

BMW 

38 

22215 

D 

0 

7 

16 

0.44 

0.68 

1.89 

-0.28 

BMW 

39 

21883 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

BMW 

39 

21883 

A 

1 

27 

60 

1.91 

0.26 

1.04 

0.50 

BMW 

39 

21883 

B 

0 

6 

13 

0.67 

0.57 

1.13 

-0.17 

BMW 

39 

21883 

C 

0 

7 

16 

0.26 

0.28 

0.53 

-0.30 

BMW 

39 

21883 

D 

0 

5 

11 

0.24 

0.84 

1.14 

-0.25 

BMW 

40 

22181 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

BMW 

40 

22181 

A 

1 

22 

49 

2.20 

0.29 

0.96 

0.47 

BMW 

40 

22181 

B 

0 

5 

11 

0.33 

0.41 

0.47 

-0.31 

BMW 

40 

22181 

C 

0 

14 

31 

1.03 

0.34 

1.17 

-0.24 

BMW 

40 

22181 

D 

0 

4 

9 

1.14 

0.41 

0.95 

-0.09 

Note.  BMW  = Benchmark  Winter. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMS 

1 

3NF28 

* 

-1 

4883 

98 

1.19 

0.02 

0.00 

-0.10 

BMS 

1 

3NF28 

A 

1 

103 

93 

2.21 

0.13 

0.96 

0.31 

BMS 

1 

3NF28 

B 

0 

7 

6 

0.82 

0.30 

0.67 

-0.25 

BMS 

1 

3NF28 

C 

0 

1 

1 

-0.65 

0.00 

0.12 

-0.20 

BMS 

1 

3NF28 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

2 

3NF259 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.07 

BMS 

2 

3NF259 

A 

1 

78 

67 

2.15 

0.14 

1.04 

0.40 

BMS 

2 

3NF259 

B 

0 

18 

16 

1.25 

0.16 

0.91 

-0.21 

BMS 

2 

3NF259 

C 

0 

20 

17 

1.05 

0.18 

0.81 

-0.30 

BMS 

2 

3NF259 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

3 

3NF280 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.08 

BMS 

3 

3NF280 

A 

1 

70 

60 

2.33 

0.13 

0.97 

0.44 

BMS 

3 

3NF280 

B 

0 

22 

19 

1.35 

0.13 

0.78 

-0.27 

BMS 

3 

3NF280 

C 

0 

24 

21 

1.36 

0.18 

0.91 

-0.28 

BMS 

3 

3NF280 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

4 

3MD51 

* 

-1 

4875 

98 

1.19 

0.02 

0.00 

-0.10 

BMS 

4 

3MD51 

A 

1 

110 

92 

2.14 

0.12 

0.99 

0.26 

BMS 

4 

3MD51 

B 

0 

4 

3 

0.55 

0.43 

0.49 

-0.22 

BMS 

4 

3MD51 

C 

0 

5 

4 

1.22 

0.57 

1.51 

-0.14 

BMS 

4 

3MD51 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

5 

3MD25 

* 

-1 

4867 

97 

1.19 

0.02 

0.00 

-0.08 

BMS 

5 

3MD25 

A 

1 

88 

69 

2.40 

0.12 

0.82 

0.60 

BMS 

5 

3MD25 

B 

0 

23 

18 

0.80 

0.17 

0.58 

-0.42 

BMS 

5 

3MD25 

C 

0 

16 

13 

0.77 

0.20 

0.58 

-0.35 

BMS 

5 

3MD25 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

Note.  BMS  = Benchmark  Spring. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMS 

6 

3MD33 

* 

-1 

4884 

98 

1.20 

0.02 

0.00 

-0.04 

BMS 

6 

3MD33 

A 

1 

56 

51 

2.01 

0.16 

1.15 

0.38 

BMS 

6 

3MD33 

B 

0 

33 

30 

0.89 

0.15 

0.91 

-0.36 

BMS 

6 

3MD33 

C 

0 

21 

19 

1.41 

0.25 

1.60 

-0.06 

BMS 

6 

3MD33 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

7 

31019 

* 

-1 

4958 

99 

1.21 

0.02 

0.00 

0.04 

BMS 

7 

31019 

A 

1 

32 

89 

0.78 

0.18 

0.92 

0.36 

BMS 

7 

31019 

B 

0 

4 

11 

-0.35 

0.21 

0.53 

-0.36 

BMS 

7 

31019 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

7 

31019 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

8 

3G110 

* 

-1 

4743 

95 

1.16 

0.02 

0.00 

-0.13 

BMS 

8 

3G110 

A 

1 

235 

94 

2.10 

0.08 

0.91 

0.35 

BMS 

8 

3G110 

B 

0 

7 

3 

-0.05 

0.22 

0.27 

-0.28 

BMS 

8 

3G110 

C 

0 

9 

4 

0.61 

0.32 

0.69 

-0.21 

BMS 

8 

3G110 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

9 

3G211 

* 

-1 

4886 

98 

1.18 

0.02 

0.00 

-0.11 

BMS 

9 

3G211 

A 

1 

97 

90 

2.42 

0.14 

0.93 

0.40 

BMS 

9 

3G211 

B 

0 

7 

6 

0.51 

0.45 

0.93 

-0.30 

BMS 

9 

3G211 

C 

0 

4 

4 

0.28 

0.47 

0.45 

-0.25 

BMS 

9 

3G211 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

10 

30704 

* 

-1 

4954 

99 

1.21 

0.02 

0.00 

0.01 

BMS 

10 

30704 

A 

1 

30 

75 

1.11 

0.21 

1.10 

0.16 

BMS 

10 

30704 

B 

0 

2 

5 

0.21 

0.08 

0.59 

-0.16 

BMS 

10 

30704 

C 

0 

1 

3 

0.55 

0.00 

0.83 

-0.07 

BMS 

10 

30704 

D 

0 

7 

18 

0.87 

0.51 

1.94 

-0.06 

Note.  BMS  = Benchmark  Spring. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMS 

11 

31165 

* 

-1 

4931 

99 

1.21 

0.02 

0.00 

0.05 

BMS 

11 

31165 

A 

1 

35 

56 

1.05 

0.16 

0.92 

0.53 

BMS 

11 

31165 

B 

0 

2 

3 

0.37 

0.30 

0.89 

-0.04 

BMS 

11 

31165 

C 

0 

6 

10 

0.02 

0.19 

0.65 

-0.17 

BMS 

11 

31165 

D 

0 

20 

32 

-0.09 

0.21 

0.75 

-0.44 

BMS 

12 

3G129 

* 

-1 

4869 

97 

1.19 

0.02 

0.00 

-0.08 

BMS 

12 

3G129 

A 

1 

86 

69 

2.23 

0.13 

1.14 

0.39 

BMS 

12 

3G129 

B 

0 

19 

15 

1.03 

0.19 

0.71 

-0.30 

BMS 

12 

3G129 

C 

0 

20 

16 

1.32 

0.26 

1.53 

-0.20 

BMS 

12 

3G129 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

13 

30900 

* 

-1 

4692 

94 

1.17 

0.02 

0.00 

-0.09 

BMS 

13 

30900 

A 

1 

158 

52 

2.28 

0.10 

1.07 

0.48 

BMS 

13 

30900 

B 

0 

119 

39 

1.14 

0.09 

1.02 

-0.35 

BMS 

13 

30900 

C 

0 

16 

5 

0.90 

0.21 

0.71 

-0.15 

BMS 

13 

30900 

D 

0 

9 

3 

-0.02 

0.17 

0.22 

-0.23 

BMS 

14 

30206 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

BMS 

14 

30206 

A 

1 

49 

86 

0.90 

0.14 

0.91 

0.40 

BMS 

14 

30206 

B 

0 

4 

7 

-0.19 

0.67 

1.07 

-0.23 

BMS 

14 

30206 

C 

0 

2 

4 

-0.95 

0.88 

0.38 

-0.30 

BMS 

14 

30206 

D 

0 

2 

4 

-0.07 

0.67 

0.80 

-0.14 

BMS 

15 

30236 

* 

-1 

4933 

99 

1.21 

0.02 

0.00 

0.06 

BMS 

15 

30236 

A 

1 

49 

80 

0.76 

0.14 

0.85 

0.45 

BMS 

15 

30236 

B 

0 

8 

13 

-0.94 

0.25 

0.38 

-0.53 

BMS 

15 

30236 

C 

0 

3 

5 

0.47 

0.60 

1.76 

-0.01 

BMS 

15 

30236 

D 

0 

1 

2 

0.80 

0.00 

1.77 

0.03 

Note.  BMS  = Benchmark  Spring. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMS 

16 

30388 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

BMS 

16 

30388 

A 

1 

42 

75 

0.91 

0.19 

1.07 

0.33 

BMS 

16 

30388 

B 

0 

6 

11 

0.90 

0.20 

1.97 

0.06 

BMS 

16 

30388 

C 

0 

2 

4 

-0.45 

0.50 

0.52 

-0.17 

BMS 

16 

30388 

D 

0 

6 

11 

-0.81 

0.37 

0.44 

-0.41 

BMS 

17 

30527 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.02 

BMS 

17 

30527 

A 

1 

40 

71 

1.26 

0.16 

0.90 

0.50 

BMS 

17 

30527 

B 

0 

1 

2 

-0.55 

0.00 

0.28 

-0.19 

BMS 

17 

30527 

C 

0 

14 

25 

0.13 

0.18 

0.68 

-0.44 

BMS 

17 

30527 

D 

0 

1 

2 

0.24 

0.00 

0.63 

-0.09 

BMS 

18 

30952 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

BMS 

18 

30952 

A 

1 

34 

60 

1.26 

0.24 

1.99 

0.45 

BMS 

18 

30952 

B 

0 

4 

7 

0.70 

0.43 

1.44 

-0.01 

BMS 

18 

30952 

C 

0 

4 

7 

-0.13 

0.49 

0.65 

-0.18 

BMS 

18 

30952 

D 

0 

15 

26 

-0.12 

0.24 

0.72 

-0.39 

BMS 

19 

30091 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.03 

BMS 

19 

30091 

A 

1 

23 

40 

1.43 

0.29 

1.21 

0.44 

BMS 

19 

30091 

B 

0 

3 

5 

-0.57 

0.34 

0.28 

-0.27 

BMS 

19 

30091 

C 

0 

12 

21 

0.43 

0.21 

0.90 

-0.16 

BMS 

19 

30091 

D 

0 

20 

34 

0.49 

0.18 

0.94 

-0.19 

BMS 

20 

30224 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.03 

BMS 

20 

30224 

A 

1 

8 

14 

2.16 

0.54 

0.92 

0.44 

BMS 

20 

30224 

B 

0 

39 

67 

0.76 

0.16 

0.92 

-0.11 

BMS 

20 

30224 

C 

0 

4 

7 

0.10 

0.62 

0.50 

-0.17 

BMS 

20 

30224 

D 

0 

7 

12 

0.30 

0.45 

0.63 

-0.17 

Note.  BMS  = Benchmark  Spring. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMS 

21 

30155 

* 

-1 

4926 

99 

1.21 

0.02 

0.00 

0.03 

BMS 

21 

30155 

A 

1 

58 

85 

1.03 

0.12 

0.91 

0.46 

BMS 

21 

30155 

B 

0 

4 

6 

0.05 

0.44 

0.81 

-0.20 

BMS 

21 

30155 

C 

0 

2 

3 

-0.65 

0.30 

0.32 

-0.26 

BMS 

21 

30155 

D 

0 

4 

6 

-0.40 

0.39 

0.50 

-0.31 

BMS 

22 

31092 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.02 

BMS 

22 

31092 

A 

1 

46 

81 

1.18 

0.18 

0.96 

0.44 

BMS 

22 

31092 

B 

0 

1 

2 

-0.01 

0.00 

0.59 

-0.10 

BMS 

22 

31092 

C 

0 

2 

4 

0.17 

0.34 

0.75 

-0.11 

BMS 

22 

31092 

D 

0 

8 

14 

-0.31 

0.14 

0.47 

-0.40 

BMS 

23 

31074 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.03 

BMS 

23 

31074 

A 

1 

39 

72 

1.14 

0.20 

1.00 

0.45 

BMS 

23 

31074 

B 

0 

1 

2 

-0.61 

0.00 

0.34 

-0.16 

BMS 

23 

31074 

C 

0 

12 

22 

-0.13 

0.18 

0.64 

-0.40 

BMS 

23 

31074 

D 

0 

2 

4 

0.24 

0.20 

0.81 

-0.09 

BMS 

24 

30A43 

* 

-1 

4887 

98 

1.18 

0.02 

0.00 

-0.11 

BMS 

24 

30A43 

A 

1 

83 

78 

2.67 

0.15 

0.88 

0.55 

BMS 

24 

30A43 

B 

0 

9 

8 

0.45 

0.31 

0.43 

-0.36 

BMS 

24 

30A43 

C 

0 

15 

14 

0.82 

0.22 

0.62 

-0.38 

BMS 

24 

30A43 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

25 

30942 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.02 

BMS 

25 

30942 

A 

1 

30 

55 

1.41 

0.20 

1.03 

0.46 

BMS 

25 

30942 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

25 

30942 

C 

0 

12 

22 

0.42 

0.23 

0.84 

-0.27 

BMS 

25 

30942 

D 

0 

13 

24 

0.43 

0.24 

0.89 

-0.28 

Note.  BMS  = Benchmark  Spring. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMS 

26 

30772 

* 

-1 

4943 

99 

1.21 

0.02 

0.00 

0.04 

BMS 

26 

30772 

A 

1 

19 

37 

1.32 

0.21 

0.82 

0.46 

BMS 

26 

30772 

B 

0 

8 

16 

0.63 

0.29 

1.10 

-0.04 

BMS 

26 

30772 

C 

0 

10 

20 

0.29 

0.28 

0.78 

-0.22 

BMS 

26 

30772 

D 

0 

14 

27 

0.29 

0.27 

1.03 

-0.27 

BMS 

27 

30794 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.05 

BMS 

27 

30794 

A 

1 

11 

19 

1.27 

0.30 

1.07 

0.31 

BMS 

27 

30794 

B 

0 

6 

10 

0.25 

0.10 

0.52 

-0.13 

BMS 

27 

30794 

C 

0 

38 

64 

0.58 

0.17 

1.11 

-0.08 

BMS 

27 

30794 

D 

0 

4 

7 

0.05 

0.28 

0.47 

-0.16 

BMS 

28 

3NBT321 

* 

-1 

4888 

98 

1.19 

0.02 

0.00 

-0.07 

BMS 

28 

3NBT321 

A 

1 

83 

78 

2.04 

0.11 

1.13 

0.44 

BMS 

28 

3NBT321 

B 

0 

20 

19 

0.89 

0.15 

0.64 

-0.42 

BMS 

28 

3NBT321 

C 

0 

3 

3 

1.13 

0.10 

0.67 

-0.11 

BMS 

28 

3NBT321 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

29 

3NBT220 

* 

-1 

4887 

98 

1.19 

0.02 

0.00 

-0.07 

BMS 

29 

3NBT220 

A 

1 

74 

69 

2.06 

0.11 

1.09 

0.37 

BMS 

29 

3NBT220 

B 

0 

20 

19 

1.21 

0.22 

0.96 

-0.27 

BMS 

29 

3NBT220 

C 

0 

13 

12 

1.25 

0.31 

1.28 

-0.20 

BMS 

29 

3NBT220 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

30 

3NBT117 

* 

-1 

4881 

98 

1.18 

0.02 

0.00 

-0.12 

BMS 

30 

3NBT117 

A 

1 

81 

72 

2.62 

0.14 

1.06 

0.40 

BMS 

30 

3NBT117 

B 

0 

17 

15 

1.69 

0.17 

0.89 

-0.21 

BMS 

30 

3NBT117 

C 

0 

15 

13 

1.31 

0.28 

0.93 

-0.31 

BMS 

30 

3NBT117 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

Note.  BMS  = Benchmark  Spring. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMS 

31 

4G232 

* 

-1 

4675 

96 

0.99 

0.02 

0.00 

-0.04 

BMS 

31 

4G232 

A 

1 

141 

67 

1.52 

0.07 

0.90 

0.44 

BMS 

31 

4G232 

B 

0 

52 

25 

0.81 

0.10 

0.95 

-0.30 

BMS 

31 

4G232 

C 

0 

16 

8 

0.42 

0.20 

0.66 

-0.28 

BMS 

31 

4G232 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

32 

40A37 

* 

-1 

4764 

98 

0.99 

0.02 

0.00 

-0.04 

BMS 

32 

40A37 

A 

1 

98 

82 

1.46 

0.09 

1.00 

0.38 

BMS 

32 

40A37 

B 

0 

12 

10 

0.72 

0.18 

0.83 

-0.22 

BMS 

32 

40A37 

C 

0 

10 

8 

0.48 

0.19 

0.63 

-0.29 

BMS 

32 

40A37 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

33 

40592 

* 

-1 

4835 

99 

1.00 

0.02 

0.00 

0.00 

BMS 

33 

40592 

A 

1 

40 

82 

1.38 

0.18 

0.84 

0.53 

BMS 

33 

40592 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

33 

40592 

C 

0 

4 

8 

0.85 

0.24 

1.25 

-0.03 

BMS 

33 

40592 

D 

0 

5 

10 

-1.92 

0.83 

0.18 

-0.65 

BMS 

34 

40A418 

* 

-1 

4779 

98 

0.98 

0.02 

0.00 

-0.08 

BMS 

34 

40A418 

A 

1 

65 

62 

1.94 

0.15 

1.14 

0.30 

BMS 

34 

40A418 

B 

0 

20 

19 

1.12 

0.16 

0.92 

-0.25 

BMS 

34 

40A418 

C 

0 

20 

19 

1.42 

0.16 

1.23 

-0.12 

BMS 

34 

40A418 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

35 

40A54 

* 

-1 

4660 

95 

0.97 

0.02 

0.00 

-0.11 

BMS 

35 

40A54 

A 

1 

116 

52 

2.14 

0.11 

1.09 

0.42 

BMS 

35 

40A54 

B 

0 

49 

22 

1.29 

0.12 

1.10 

-0.17 

BMS 

35 

40A54 

C 

0 

59 

26 

1.02 

0.12 

0.83 

-0.32 

BMS 

35 

40A54 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

Note.  BMS  = Benchmark  Spring. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMS 

36 

2G327 

* 

-1 

3924 

98 

1.51 

0.02 

0.00 

-0.05 

BMS 

36 

2G327 

A 

1 

62 

91 

2.20 

0.17 

0.85 

0.34 

BMS 

36 

2G327 

B 

0 

1 

1 

-0.19 

0.00 

0.22 

-0.19 

BMS 

36 

2G327 

C 

0 

5 

7 

0.62 

0.81 

1.46 

-0.28 

BMS 

36 

2G327 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

37 

23333 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

BMS 

37 

23333 

A 

1 

35 

78 

1.64 

0.24 

0.89 

0.51 

BMS 

37 

23333 

B 

0 

3 

7 

-0.34 

0.93 

0.83 

-0.28 

BMS 

37 

23333 

C 

0 

4 

9 

-0.11 

0.48 

0.64 

-0.28 

BMS 

37 

23333 

D 

0 

3 

7 

-0.27 

0.36 

0.45 

-0.26 

BMS 

38 

22110 

* 

-1 

3949 

99 

1.51 

0.02 

0.00 

-0.01 

BMS 

38 

22110 

A 

1 

30 

70 

2.34 

0.29 

0.82 

0.56 

BMS 

38 

22110 

B 

0 

5 

12 

-0.45 

0.30 

0.28 

-0.44 

BMS 

38 

22110 

C 

0 

7 

16 

0.84 

0.51 

2.41 

-0.21 

BMS 

38 

22110 

D 

0 

1 

2 

-1.01 

0.00 

0.13 

-0.24 

BMS 

39 

2NBT33 

* 

-1 

3926 

98 

1.50 

0.02 

0.00 

-0.07 

BMS 

39 

2NBT33 

A 

1 

50 

76 

2.60 

0.17 

0.93 

0.44 

BMS 

39 

2NBT33 

B 

0 

4 

6 

0.49 

0.50 

0.39 

-0.34 

BMS 

39 

2NBT33 

C 

0 

12 

18 

1.49 

0.34 

1.22 

-0.28 

BMS 

39 

2NBT33 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

40 

22316 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

BMS 

40 

22316 

A 

1 

24 

53 

2.68 

0.32 

1.09 

0.57 

BMS 

40 

22316 

B 

0 

11 

24 

1.17 

0.34 

1.30 

-0.24 

BMS 

40 

22316 

C 

0 

4 

9 

0.26 

0.35 

0.36 

-0.31 

BMS 

40 

22316 

D 

0 

6 

13 

0.76 

0.34 

0.65 

-0.27 

Note.  BMS  = Benchmark  Spring. 
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Appendix  D:  Item  Statistics 


Appendix  D:  Item  Statistics  for  Full  CCSS  Item  Bank 
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Appendix  D:  Item  Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30001 

-0.88 

35 

29 

0.48 

0.66 

-1.27 

0.40 

-1.43 

0.00 

0.67 

1.39 

30002 

0.07 

62 

37 

0.29 

0.73 

-2.47 

0.62 

-2.04 

0.00 

0.63 

1.68 

30003 

0.46 

60 

35 

0.29 

1.02 

0.22 

0.98 

-0.07 

0.00 

0.38 

0.97 

30004 

1.20 

57 

24 

0.30 

1.13 

1.13 

1.09 

0.52 

0.00 

0.35 

0.68 

30005 

0.51 

42 

21 

0.34 

0.79 

-1.68 

0.73 

-1.54 

0.00 

0.62 

1.62 

30006 

0.79 

47 

24 

0.32 

1.04 

0.41 

1.15 

0.85 

0.00 

0.36 

0.80 

30007 

1.46 

297 

167 

0.13 

0.97 

-0.62 

0.95 

-0.56 

0.00 

0.49 

1.08 

30008 

1.08 

57 

24 

0.30 

1.12 

1.08 

1.14 

0.56 

0.00 

0.33 

0.64 

30009 

3.16 

55 

6 

0.50 

1.16 

0.54 

1.28 

0.60 

0.00 

0.35 

0.90 

30010 

3.64 

57 

5 

0.51 

0.80 

-0.43 

0.70 

-0.29 

0.00 

0.48 

1.11 

30011 

-1.00 

41 

33 

0.43 

0.84 

-0.60 

0.70 

-0.71 

0.00 

0.52 

1.20 

30012 

0.06 

58 

37 

0.31 

1.06 

0.46 

1.07 

0.39 

0.00 

0.39 

0.86 

30013 

-1.56 

282 

266 

0.28 

1.05 

0.31 

1.10 

0.37 

0.00 

0.28 

1.00 

30014 

-0.94 

54 

45 

0.38 

1.05 

0.30 

1.16 

0.54 

0.00 

0.19 

0.94 

30015 

1.56 

57 

20 

0.33 

1.22 

1.36 

1.38 

1.59 

0.00 

0.38 

0.57 

30016 

1.14 

58 

25 

0.29 

0.95 

-0.49 

0.93 

-0.42 

0.00 

0.43 

1.18 

30017 

1.01 

58 

27 

0.30 

0.97 

-0.26 

0.95 

-0.09 

0.00 

0.45 

1.09 

30018 

-0.67 

57 

44 

0.34 

1.01 

0.11 

0.93 

-0.17 

0.00 

0.34 

1.01 

30019 

0.38 

59 

31 

0.29 

0.88 

-1.20 

0.79 

-1.07 

0.00 

0.53 

1.42 

30020 

-0.95 

57 

46 

0.36 

0.93 

-0.28 

0.70 

-0.69 

0.00 

0.44 

1.13 

30021 

-0.48 

62 

43 

0.31 

1.14 

1.01 

1.08 

0.41 

0.00 

0.32 

0.77 

30022 

-0.81 

278 

242 

0.20 

0.87 

-1.07 

0.57 

-1.56 

0.00 

0.45 

1.14 

30023 

-1.19 

56 

47 

0.38 

1.11 

0.56 

1.15 

0.46 

0.00 

0.19 

0.87 

30024 

0.66 

55 

29 

0.30 

0.90 

-1.02 

0.82 

-0.86 

0.00 

0.50 

1.38 

30025 

1.96 

64 

20 

0.30 

0.82 

-1.33 

0.91 

-0.27 

0.00 

0.55 

1.28 

30026 

1.00 

59 

24 

0.30 

1.21 

1.69 

1.46 

2.14 

0.00 

0.25 

0.40 

30027 

0.91 

50 

26 

0.31 

0.90 

-0.89 

0.85 

-0.90 

0.00 

0.48 

1.35 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30028 

1.94 

58 

17 

0.33 

0.93 

-0.43 

0.79 

-0.66 

0.00 

0.51 

1.15 

30029 

-1.28 

55 

46 

0.38 

0.92 

-0.29 

0.95 

0.02 

0.00 

0.36 

1.07 

30030 

-0.75 

64 

48 

0.32 

0.91 

-0.55 

0.78 

-0.76 

0.00 

0.48 

1.17 

30031 

-0.16 

66 

43 

0.29 

0.81 

-1.59 

0.74 

-1.41 

0.00 

0.58 

1.41 

30032 

-1.00 

54 

43 

0.36 

0.95 

-0.19 

1.00 

0.14 

0.00 

0.34 

1.04 

30033 

2.14 

58 

16 

0.32 

0.89 

-0.67 

0.93 

-0.17 

0.00 

0.47 

1.15 

30034 

2.42 

59 

10 

0.38 

0.98 

-0.03 

1.00 

0.15 

0.00 

0.40 

1.00 

30035 

0.71 

48 

25 

0.32 

0.99 

-0.02 

0.97 

-0.13 

0.00 

0.43 

1.03 

30036 

0.33 

55 

33 

0.31 

0.80 

-1.52 

0.72 

-1.45 

0.00 

0.63 

1.44 

30037 

0.28 

58 

35 

0.31 

1.14 

1.06 

1.08 

0.44 

0.00 

0.37 

0.72 

30038 

1.09 

58 

24 

0.30 

0.93 

-0.59 

0.86 

-0.90 

0.00 

0.44 

1.24 

30039 

0.04 

57 

35 

0.30 

0.97 

-0.23 

1.02 

0.15 

0.00 

0.41 

1.05 

30040 

0.81 

56 

25 

0.29 

0.90 

-0.96 

0.84 

-1.01 

0.00 

0.50 

1.36 

30041 

1.40 

50 

17 

0.34 

0.73 

-1.93 

0.64 

-1.69 

0.00 

0.63 

1.55 

30042 

0.48 

57 

32 

0.30 

0.89 

-0.97 

0.81 

-1.09 

0.00 

0.54 

1.35 

30043 

1.71 

52 

16 

0.33 

0.78 

-1.53 

0.68 

-1.47 

0.00 

0.61 

1.43 

30044 

0.17 

54 

31 

0.30 

0.98 

-0.18 

0.94 

-0.33 

0.00 

0.42 

1.09 

30045 

0.70 

54 

28 

0.30 

1.05 

0.47 

1.03 

0.22 

0.00 

0.39 

0.86 

30046 

0.83 

50 

25 

0.32 

0.77 

-2.05 

0.70 

-1.79 

0.00 

0.63 

1.67 

30047 

-0.55 

304 

264 

0.18 

0.86 

-1.28 

0.60 

-1.73 

0.00 

0.45 

1.16 

30048 

-0.10 

61 

39 

0.30 

0.86 

-1.06 

0.76 

-1.19 

0.00 

0.56 

1.32 

30049 

0.41 

56 

29 

0.30 

1.06 

0.53 

1.13 

0.79 

0.00 

0.37 

0.78 

30050 

-0.81 

56 

44 

0.35 

0.85 

-0.82 

0.65 

-0.88 

0.00 

0.47 

1.25 

30051 

-0.97 

50 

41 

0.39 

0.93 

-0.26 

0.71 

-0.77 

0.00 

0.44 

1.12 

30052 

-1.30 

51 

44 

0.42 

0.95 

-0.10 

0.83 

-0.11 

0.00 

0.30 

1.05 

30053 

-0.57 

58 

45 

0.33 

0.96 

-0.21 

0.74 

-0.68 

0.00 

0.38 

1.13 

30054 

-1.18 

50 

43 

0.43 

1.03 

0.20 

0.97 

0.07 

0.00 

0.28 

0.99 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30055 

-2.90 

57 

55 

0.75 

0.82 

-0.09 

1.03 

0.39 

0.00 

0.26 

1.04 

30056 

-0.89 

51 

40 

0.37 

0.93 

-0.34 

0.71 

-0.58 

0.00 

0.43 

1.15 

30057 

-2.56 

57 

54 

0.62 

1.01 

0.19 

0.60 

-0.27 

0.00 

0.26 

1.03 

30058 

-0.75 

57 

43 

0.33 

1.15 

0.93 

1.26 

0.95 

0.00 

0.18 

0.75 

30059 

-0.83 

68 

57 

0.34 

1.04 

0.24 

0.90 

-0.16 

0.00 

0.26 

0.99 

30060 

-2.07 

67 

61 

0.46 

0.98 

0.05 

0.74 

-0.20 

0.00 

0.31 

1.04 

30061 

-3.17 

56 

54 

0.74 

1.07 

0.32 

0.93 

0.28 

0.00 

0.11 

0.96 

30062 

-2.03 

54 

50 

0.54 

0.89 

-0.15 

0.46 

-0.63 

0.00 

0.33 

1.12 

30063 

-3.69 

53 

52 

1.03 

0.93 

0.23 

0.22 

-0.36 

0.00 

0.25 

1.08 

30064 

-3.11 

57 

55 

0.74 

0.78 

-0.17 

0.25 

-0.66 

0.00 

0.36 

1.14 

30065 

-2.97 

62 

60 

0.73 

1.00 

0.22 

0.73 

0.09 

0.00 

0.15 

1.01 

30066 

-3.42 

57 

55 

0.75 

0.69 

-0.36 

0.14 

-0.86 

0.00 

0.44 

1.19 

30067 

-2.07 

55 

51 

0.54 

0.88 

-0.17 

0.55 

-0.39 

0.00 

0.34 

1.10 

30068 

-3.97 

60 

59 

1.02 

1.05 

0.37 

1.30 

0.66 

0.00 

0.03 

0.95 

30069 

-3.63 

60 

59 

1.02 

1.04 

0.35 

0.97 

0.44 

0.00 

0.06 

0.97 

30070 

-3.33 

55 

54 

1.02 

0.94 

0.25 

0.29 

-0.32 

0.00 

0.24 

1.07 

30071 

2.97 

58 

8 

0.42 

0.96 

-0.05 

0.98 

0.12 

0.00 

0.40 

1.02 

30072 

2.85 

60 

8 

0.41 

1.10 

0.47 

3.02 

3.05 

0.00 

0.05 

0.72 

30073 

-0.09 

57 

34 

0.31 

1.07 

0.57 

1.25 

0.97 

0.00 

0.40 

0.76 

30074 

2.68 

53 

10 

0.41 

1.08 

0.39 

1.74 

1.59 

0.00 

0.38 

0.82 

30075 

0.79 

58 

32 

0.29 

1.11 

1.06 

1.12 

0.74 

0.00 

0.30 

0.64 

30076 

2.25 

46 

10 

0.40 

1.20 

0.91 

1.60 

1.51 

0.00 

0.22 

0.67 

30077 

2.97 

58 

10 

0.39 

1.06 

0.34 

1.11 

0.41 

0.00 

0.37 

0.94 

30078 

1.90 

58 

16 

0.34 

1.40 

2.13 

2.18 

3.28 

0.00 

0.15 

0.29 

30079 

2.45 

57 

11 

0.37 

1.08 

0.42 

1.68 

1.48 

0.00 

0.25 

0.82 

30080 

1.16 

55 

22 

0.30 

0.94 

-0.52 

0.87 

-0.72 

0.00 

0.47 

1.21 

30081 

2.93 

56 

7 

0.42 

0.91 

-0.22 

2.27 

1.98 

0.00 

0.27 

1.00 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30082 

-1.00 

58 

47 

0.36 

1.14 

0.74 

1.27 

0.78 

0.00 

0.19 

0.80 

30083 

-0.99 

59 

47 

0.35 

1.04 

0.27 

1.20 

0.68 

0.00 

0.27 

0.90 

30084 

2.67 

55 

9 

0.40 

1.12 

0.54 

1.02 

0.18 

0.00 

0.28 

0.90 

30085 

2.90 

57 

7 

0.44 

1.29 

1.01 

5.87 

4.26 

0.00 

-0.03 

0.54 

30086 

0.58 

285 

199 

0.14 

1.21 

2.96 

1.23 

1.79 

0.00 

0.28 

0.63 

30087 

-1.21 

62 

53 

0.37 

0.99 

0.02 

0.85 

-0.26 

0.00 

0.28 

1.03 

30088 

-1.29 

57 

49 

0.40 

1.06 

0.30 

0.84 

-0.18 

0.00 

0.24 

0.98 

30089 

-1.15 

60 

50 

0.37 

0.89 

-0.42 

1.20 

0.61 

0.00 

0.39 

1.05 

30090 

-1.12 

57 

46 

0.37 

0.72 

-1.30 

0.57 

-1.30 

0.00 

0.59 

1.30 

30091 

1.28 

58 

23 

0.30 

1.00 

0.05 

1.08 

0.48 

0.00 

0.44 

0.96 

30092 

0.96 

58 

25 

0.29 

0.90 

-0.90 

0.82 

-1.04 

0.00 

0.52 

1.32 

30093 

0.13 

51 

32 

0.32 

1.09 

0.76 

1.08 

0.42 

0.00 

0.35 

0.77 

30094 

-0.56 

58 

42 

0.31 

0.89 

-0.74 

0.86 

-0.63 

0.00 

0.45 

1.21 

30095 

-0.06 

56 

38 

0.31 

1.00 

0.05 

0.99 

0.02 

0.00 

0.39 

1.01 

30096 

2.09 

53 

11 

0.37 

1.41 

1.84 

1.63 

1.44 

0.00 

0.08 

0.47 

30097 

0.17 

57 

31 

0.31 

0.79 

-1.88 

0.69 

-1.45 

0.00 

0.58 

1.60 

30098 

0.14 

58 

37 

0.31 

0.80 

-1.55 

0.69 

-1.51 

0.00 

0.60 

1.44 

30099 

0.02 

53 

36 

0.32 

0.97 

-0.15 

0.97 

-0.06 

0.00 

0.41 

1.05 

30100 

0.12 

58 

37 

0.30 

0.86 

-1.27 

0.80 

-0.99 

0.00 

0.52 

1.38 

30101 

-1.39 

49 

41 

0.44 

0.66 

-1.32 

0.44 

-0.98 

0.00 

0.60 

1.31 

30102 

-1.78 

37 

33 

0.64 

0.72 

-0.48 

0.31 

-0.90 

0.00 

0.70 

1.21 

30103 

-1.18 

57 

49 

0.41 

0.99 

0.06 

0.88 

-0.06 

0.00 

0.36 

1.01 

30104 

-0.15 

40 

26 

0.36 

0.86 

-1.04 

0.81 

-0.74 

0.00 

0.49 

1.38 

30105 

-0.45 

43 

31 

0.37 

1.13 

0.84 

1.08 

0.34 

0.00 

0.25 

0.76 

30106 

-1.58 

45 

39 

0.48 

1.02 

0.18 

0.96 

0.15 

0.00 

0.33 

0.97 

30107 

-1.81 

44 

40 

0.56 

0.71 

-0.65 

0.33 

-0.91 

0.00 

0.55 

1.22 

30108 

-2.03 

43 

40 

0.62 

0.89 

-0.08 

0.41 

-0.47 

0.00 

0.35 

1.12 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30109 

-0.54 

47 

35 

0.36 

0.94 

-0.32 

0.81 

-0.40 

0.00 

0.38 

1.14 

30110 

-1.95 

39 

36 

0.62 

0.81 

-0.27 

0.35 

-0.52 

0.00 

0.41 

1.17 

30111 

-2.85 

53 

51 

0.74 

1.13 

0.41 

1.66 

0.88 

0.00 

0.02 

0.88 

30112 

0.00 

44 

44 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

30113 

-2.22 

54 

51 

0.60 

1.06 

0.28 

0.95 

0.18 

0.00 

0.11 

0.97 

30114 

-1.16 

51 

43 

0.41 

1.01 

0.10 

0.88 

-0.08 

0.00 

0.29 

1.01 

30115 

-3.17 

43 

42 

1.02 

0.92 

0.23 

0.30 

-0.31 

0.00 

0.24 

1.08 

30116 

-2.02 

36 

33 

0.64 

1.19 

0.55 

1.21 

0.52 

0.00 

0.13 

0.86 

30117 

-1.09 

46 

37 

0.39 

0.75 

-1.18 

0.51 

-1.35 

0.00 

0.57 

1.35 

30118 

-3.66 

39 

38 

1.03 

1.11 

0.42 

2.46 

1.21 

0.00 

-0.07 

0.86 

30119 

-1.86 

55 

46 

0.44 

1.05 

0.27 

0.72 

-0.36 

0.00 

0.52 

1.02 

30120 

-2.14 

66 

60 

0.45 

0.87 

-0.31 

0.67 

-0.46 

0.00 

0.39 

1.09 

30121 

-3.75 

55 

54 

1.03 

1.09 

0.40 

1.12 

0.55 

0.00 

0.06 

0.94 

30122 

-2.14 

57 

53 

0.55 

0.75 

-0.51 

1.09 

0.36 

0.00 

0.39 

1.11 

30123 

-1.67 

52 

46 

0.45 

1.09 

0.40 

0.88 

-0.03 

0.00 

0.21 

0.95 

30124 

-1.39 

42 

36 

0.48 

0.95 

-0.08 

0.94 

0.07 

0.00 

0.37 

1.03 

30125 

-3.71 

38 

37 

1.27 

0.25 

-0.80 

0.03 

-1.02 

0.00 

0.74 

1.25 

30126 

1.73 

37 

12 

0.37 

1.17 

1.18 

1.22 

0.62 

0.00 

0.13 

0.48 

30127 

-3.29 

51 

50 

1.02 

0.95 

0.25 

0.29 

-0.24 

0.00 

0.23 

1.07 

30128 

-2.26 

50 

47 

0.62 

0.91 

-0.03 

0.37 

-0.66 

0.00 

0.40 

1.11 

30129 

-1.77 

48 

43 

0.49 

0.96 

0.00 

1.14 

0.42 

0.00 

0.25 

0.98 

30130 

1.88 

35 

10 

0.41 

1.33 

1.53 

1.66 

1.70 

0.00 

0.06 

0.35 

30131 

-1.50 

59 

50 

0.39 

0.82 

-0.72 

0.56 

-1.00 

0.00 

0.49 

1.21 

30132 

-0.83 

59 

44 

0.33 

1.21 

1.31 

1.45 

1.31 

0.00 

0.16 

0.60 

30133 

-0.34 

66 

47 

0.30 

0.92 

-0.53 

0.90 

-0.40 

0.00 

0.45 

1.14 

30134 

-2.74 

54 

51 

0.64 

0.86 

-0.12 

0.51 

-0.29 

0.00 

0.39 

1.08 

30135 

-4.02 

37 

36 

1.19 

0.32 

-0.73 

0.04 

-0.95 

0.00 

0.61 

1.25 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30136 

2.52 

55 

12 

0.38 

1.26 

1.16 

2.27 

2.55 

0.00 

0.24 

0.55 

30137 

-0.77 

61 

49 

0.35 

1.26 

1.25 

2.54 

3.25 

0.00 

0.11 

0.60 

30138 

-0.43 

67 

51 

0.31 

1.14 

0.92 

1.54 

1.95 

0.00 

0.12 

0.68 

30139 

-2.45 

56 

53 

0.61 

1.04 

0.25 

1.25 

0.56 

0.00 

0.13 

0.96 

30140 

-0.90 

58 

45 

0.36 

1.00 

0.05 

0.82 

-0.33 

0.00 

0.44 

1.04 

30141 

-0.65 

58 

43 

0.32 

0.82 

-1.26 

0.64 

-1.35 

0.00 

0.54 

1.36 

30142 

-0.33 

66 

47 

0.30 

0.89 

-0.72 

0.98 

0.00 

0.00 

0.50 

1.13 

30143 

-1.62 

47 

42 

0.49 

0.99 

0.07 

1.93 

1.44 

0.00 

0.17 

0.92 

30144 

-0.56 

48 

35 

0.35 

1.19 

1.25 

1.50 

1.47 

0.00 

0.13 

0.53 

30145 

-1.37 

59 

51 

0.40 

0.93 

-0.20 

0.71 

-0.41 

0.00 

0.37 

1.09 

30146 

0.14 

56 

35 

0.31 

1.10 

0.86 

1.09 

0.50 

0.00 

0.35 

0.75 

30147 

-0.62 

59 

44 

0.32 

1.17 

1.13 

1.63 

1.77 

0.00 

0.16 

0.61 

30148 

-0.44 

56 

41 

0.32 

1.01 

0.14 

0.99 

0.02 

0.00 

0.31 

0.98 

30149 

-0.51 

40 

29 

0.39 

0.86 

-0.68 

0.71 

-0.64 

0.00 

0.52 

1.26 

30150 

0.09 

43 

26 

0.34 

0.92 

-0.61 

0.83 

-0.77 

0.00 

0.48 

1.28 

30151 

-0.77 

71 

57 

0.33 

0.92 

-0.37 

1.06 

0.28 

0.00 

0.45 

1.07 

30152 

-1.24 

57 

47 

0.37 

0.94 

-0.23 

0.84 

-0.27 

0.00 

0.38 

1.08 

30153 

-0.33 

56 

40 

0.32 

0.79 

-1.58 

0.69 

-1.24 

0.00 

0.55 

1.43 

30154 

-0.75 

56 

42 

0.33 

0.99 

-0.04 

0.84 

-0.55 

0.00 

0.37 

1.07 

30155 

-1.23 

68 

58 

0.36 

0.85 

-0.60 

0.63 

-0.90 

0.00 

0.46 

1.16 

30156 

0.16 

59 

39 

0.30 

1.02 

0.21 

0.94 

-0.22 

0.00 

0.42 

0.99 

30157 

0.59 

57 

31 

0.30 

0.89 

-0.99 

0.82 

-1.01 

0.00 

0.51 

1.36 

30158 

-0.84 

61 

48 

0.33 

0.98 

-0.07 

1.19 

0.71 

0.00 

0.35 

1.01 

30159 

-0.87 

58 

44 

0.32 

0.93 

-0.41 

0.79 

-0.85 

0.00 

0.38 

1.16 

30160 

-0.54 

58 

43 

0.33 

0.94 

-0.33 

0.97 

-0.04 

0.00 

0.42 

1.08 

30161 

-2.73 

49 

47 

0.74 

0.87 

-0.01 

0.29 

-0.62 

0.00 

0.38 

1.12 

30162 

1.06 

58 

23 

0.30 

0.84 

-1.39 

0.96 

-0.15 

0.00 

0.54 

1.31 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30163 

0.00 

69 

44 

0.28 

0.89 

-0.94 

0.78 

-1.01 

0.00 

0.53 

1.28 

30164 

-2.74 

48 

46 

0.73 

0.86 

-0.02 

0.35 

-0.59 

0.00 

0.31 

1.11 

30165 

-0.14 

55 

37 

0.32 

0.87 

-0.97 

1.08 

0.39 

0.00 

0.49 

1.20 

30166 

-0.84 

57 

46 

0.36 

0.79 

-1.06 

0.58 

-1.21 

0.00 

0.52 

1.28 

30167 

-1.13 

58 

47 

0.37 

0.84 

-0.75 

0.84 

-0.26 

0.00 

0.48 

1.16 

30168 

-0.22 

47 

31 

0.35 

1.06 

0.46 

0.92 

-0.19 

0.00 

0.42 

0.93 

30169 

-0.45 

57 

40 

0.32 

0.96 

-0.23 

0.98 

0.01 

0.00 

0.44 

1.05 

30170 

0.57 

63 

35 

0.28 

1.03 

0.38 

1.00 

0.02 

0.00 

0.36 

0.92 

30171 

1.52 

55 

20 

0.31 

0.97 

-0.22 

1.05 

0.26 

0.00 

0.40 

1.03 

30172 

1.25 

47 

18 

0.33 

1.11 

0.80 

1.04 

0.29 

0.00 

0.34 

0.79 

30173 

2.18 

64 

16 

0.32 

1.26 

1.54 

1.42 

1.37 

0.00 

0.16 

0.59 

30174 

0.18 

59 

32 

0.30 

0.93 

-0.58 

0.86 

-0.54 

0.00 

0.53 

1.19 

30175 

0.07 

59 

34 

0.29 

0.94 

-0.55 

0.86 

-0.64 

0.00 

0.48 

1.21 

30176 

-0.09 

57 

35 

0.29 

0.95 

-0.45 

0.92 

-0.42 

0.00 

0.43 

1.16 

30177 

0.37 

55 

30 

0.30 

0.92 

-0.74 

0.94 

-0.36 

0.00 

0.47 

1.23 

30178 

0.75 

47 

25 

0.33 

0.79 

-1.75 

0.70 

-1.24 

0.00 

0.60 

1.59 

30179 

1.51 

56 

19 

0.31 

0.87 

-1.06 

0.82 

-0.79 

0.00 

0.51 

1.31 

30180 

2.34 

52 

11 

0.37 

0.96 

-0.15 

0.82 

-0.25 

0.00 

0.38 

1.08 

30181 

2.18 

56 

13 

0.35 

1.38 

1.91 

3.25 

4.21 

0.00 

0.02 

0.34 

30182 

0.81 

58 

30 

0.29 

0.98 

-0.19 

1.00 

0.05 

0.00 

0.40 

1.05 

30183 

0.26 

57 

33 

0.30 

1.23 

1.85 

1.26 

1.27 

0.00 

0.24 

0.39 

30184 

0.06 

57 

33 

0.31 

1.20 

1.51 

1.15 

0.69 

0.00 

0.34 

0.57 

30185 

0.22 

55 

34 

0.30 

0.89 

-0.99 

0.81 

-0.80 

0.00 

0.48 

1.35 

30186 

-0.79 

56 

45 

0.37 

0.96 

-0.11 

0.68 

-0.75 

0.00 

0.45 

1.11 

30187 

0.94 

57 

27 

0.30 

0.81 

-1.60 

0.75 

-1.43 

0.00 

0.57 

1.47 

30188 

-1.21 

58 

49 

0.38 

0.97 

-0.06 

0.74 

-0.44 

0.00 

0.34 

1.06 

30189 

0.93 

66 

30 

0.28 

0.80 

-1.93 

0.71 

-1.28 

0.00 

0.60 

1.54 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30190 

-1.08 

57 

49 

0.39 

1.03 

0.18 

1.04 

0.22 

0.00 

0.17 

0.97 

30191 

0.38 

57 

33 

0.30 

1.06 

0.54 

0.98 

-0.08 

0.00 

0.38 

0.89 

30192 

-0.45 

55 

42 

0.34 

0.90 

-0.54 

0.86 

-0.39 

0.00 

0.44 

1.14 

30193 

0.62 

58 

32 

0.30 

0.73 

-2.52 

0.63 

-2.40 

0.00 

0.68 

1.72 

30194 

-0.30 

57 

40 

0.32 

0.86 

-0.95 

0.76 

-1.10 

0.00 

0.49 

1.29 

30195 

0.73 

52 

29 

0.31 

0.98 

-0.15 

0.92 

-0.34 

0.00 

0.46 

1.09 

30196 

-1.22 

61 

50 

0.37 

0.97 

-0.08 

0.71 

-0.61 

0.00 

0.46 

1.08 

30197 

0.18 

57 

37 

0.31 

0.84 

-1.32 

0.70 

-1.36 

0.00 

0.53 

1.42 

30198 

-0.84 

55 

41 

0.33 

0.87 

-0.78 

0.85 

-0.44 

0.00 

0.48 

1.20 

30199 

0.45 

55 

31 

0.29 

1.07 

0.67 

1.10 

0.86 

0.00 

0.27 

0.73 

30200 

-1.24 

55 

47 

0.41 

1.01 

0.12 

1.09 

0.34 

0.00 

0.33 

1.00 

30201 

-1.89 

53 

48 

0.49 

0.97 

0.04 

0.84 

-0.05 

0.00 

0.28 

1.02 

30202 

-0.47 

55 

39 

0.33 

0.97 

-0.11 

0.91 

-0.25 

0.00 

0.46 

1.05 

30203 

-1.25 

56 

48 

0.41 

0.91 

-0.30 

0.66 

-0.63 

0.00 

0.43 

1.12 

30204 

-2.84 

57 

55 

0.73 

1.03 

0.26 

0.89 

0.23 

0.00 

0.10 

0.98 

30205 

-1.14 

64 

52 

0.35 

0.95 

-0.18 

0.77 

-0.55 

0.00 

0.43 

1.08 

30206 

-1.45 

57 

49 

0.41 

0.91 

-0.25 

0.84 

-0.18 

0.00 

0.40 

1.07 

30207 

-0.83 

53 

43 

0.38 

0.99 

0.02 

0.78 

-0.44 

0.00 

0.43 

1.06 

30208 

-0.11 

56 

38 

0.32 

0.70 

-2.10 

0.63 

-1.67 

0.00 

0.68 

1.51 

30209 

-0.36 

58 

40 

0.32 

1.15 

0.98 

1.14 

0.62 

0.00 

0.33 

0.75 

30210 

-0.54 

55 

41 

0.35 

1.00 

0.06 

0.97 

0.02 

0.00 

0.44 

1.00 

30211 

-2.56 

55 

50 

0.58 

0.90 

-0.08 

0.42 

-0.52 

0.00 

0.59 

1.10 

30212 

-3.09 

56 

54 

0.74 

0.96 

0.15 

0.41 

-0.30 

0.00 

0.25 

1.06 

30213 

-3.23 

55 

53 

0.74 

0.92 

0.08 

0.33 

-0.52 

0.00 

0.32 

1.09 

30214 

-4.05 

53 

52 

1.05 

0.64 

-0.18 

0.07 

-0.79 

0.00 

0.50 

1.18 

30215 

-3.82 

62 

61 

1.02 

1.01 

0.33 

0.46 

-0.06 

0.00 

0.16 

1.02 

30216 

0.00 

54 

54 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

easyCBM  CCSS  Third  Grade  Math  Measure  Development 


172 

Appendix  D:  Item  Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30217 

-3.68 

48 

47 

1.02 

0.87 

0.16 

0.19 

-0.43 

0.00 

0.26 

1.11 

30218 

-2.94 

56 

53 

0.68 

1.61 

1.11 

1.51 

0.78 

0.00 

0.13 

0.76 

30219 

-1.98 

56 

51 

0.53 

0.85 

-0.27 

0.43 

-0.83 

0.00 

0.52 

1.14 

30220 

-2.76 

57 

54 

0.64 

0.71 

-0.51 

0.24 

-0.84 

0.00 

0.52 

1.18 

30221 

2.99 

48 

8 

0.43 

1.02 

0.18 

1.13 

0.41 

0.00 

0.35 

0.94 

30222 

2.47 

54 

12 

0.37 

1.01 

0.11 

0.92 

-0.07 

0.00 

0.46 

1.02 

30223 

0.22 

58 

31 

0.30 

1.13 

1.03 

1.06 

0.41 

0.00 

0.39 

0.75 

30224 

3.14 

58 

8 

0.43 

0.94 

-0.13 

0.91 

0.01 

0.00 

0.44 

1.03 

30225 

0.67 

56 

28 

0.29 

1.06 

0.62 

1.08 

0.47 

0.00 

0.35 

0.77 

30226 

2.46 

58 

10 

0.37 

1.17 

0.80 

2.80 

3.43 

0.00 

-0.05 

0.62 

30227 

2.62 

54 

8 

0.43 

1.02 

0.15 

1.82 

1.56 

0.00 

0.30 

0.87 

30228 

1.55 

292 

158 

0.13 

0.86 

-2.80 

0.78 

-2.50 

0.00 

0.57 

1.38 

30229 

2.06 

59 

13 

0.34 

1.06 

0.38 

1.68 

1.97 

0.00 

0.26 

0.83 

30230 

0.76 

55 

25 

0.31 

1.34 

2.40 

1.33 

1.38 

0.00 

0.27 

0.23 

30231 

3.13 

52 

7 

0.43 

1.04 

0.23 

1.17 

0.50 

0.00 

0.24 

0.95 

30232 

-1.41 

56 

46 

0.37 

0.99 

0.04 

0.84 

-0.26 

0.00 

0.35 

1.03 

30233 

-0.59 

52 

39 

0.36 

0.92 

-0.39 

0.97 

0.05 

0.00 

0.50 

1.08 

30234 

3.20 

56 

6 

0.46 

0.84 

-0.41 

1.63 

1.07 

0.00 

0.36 

1.06 

30235 

0.88 

57 

29 

0.29 

0.97 

-0.26 

0.96 

-0.23 

0.00 

0.39 

1.11 

30236 

-1.18 

61 

49 

0.35 

0.86 

-0.68 

0.84 

-0.34 

0.00 

0.45 

1.15 

30237 

-0.15 

54 

38 

0.33 

1.18 

1.15 

1.20 

0.91 

0.00 

0.24 

0.69 

30238 

-1.38 

53 

45 

0.41 

1.08 

0.42 

1.17 

0.49 

0.00 

0.27 

0.91 

30239 

-1.10 

59 

49 

0.38 

1.16 

0.79 

1.50 

1.09 

0.00 

0.23 

0.79 

30240 

-1.19 

59 

48 

0.36 

1.04 

0.25 

0.78 

-0.40 

0.00 

0.35 

1.01 

30241 

0.31 

61 

37 

0.29 

0.99 

-0.04 

0.91 

-0.47 

0.00 

0.47 

1.07 

30242 

-0.05 

56 

37 

0.31 

1.09 

0.69 

1.12 

0.54 

0.00 

0.35 

0.79 

30243 

1.35 

51 

18 

0.34 

1.10 

0.64 

1.07 

0.37 

0.00 

0.42 

0.85 

easyCBM  CCSS  Third  Grade  Math  Measure  Development 


173 

Appendix  D:  Item  Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30244 

0.02 

57 

36 

0.30 

0.99 

-0.05 

0.96 

-0.17 

0.00 

0.38 

1.04 

30245 

1.67 

56 

18 

0.32 

0.99 

-0.05 

1.02 

0.17 

0.00 

0.43 

1.00 

30246 

0.58 

56 

30 

0.30 

1.23 

2.02 

1.27 

1.55 

0.00 

0.25 

0.28 

30247 

0.37 

55 

32 

0.30 

0.90 

-0.78 

0.90 

-0.35 

0.00 

0.49 

1.24 

30248 

0.34 

57 

32 

0.29 

1.21 

2.04 

1.34 

2.37 

0.00 

0.12 

0.16 

30249 

0.20 

48 

29 

0.32 

0.79 

-1.79 

0.70 

-1.56 

0.00 

0.60 

1.61 

30250 

-0.31 

49 

34 

0.34 

0.83 

-1.20 

0.87 

-0.43 

0.00 

0.52 

1.31 

30251 

-2.56 

35 

33 

0.75 

0.69 

-0.38 

0.21 

-0.80 

0.00 

0.54 

1.21 

30252 

-1.54 

47 

42 

0.50 

1.06 

0.29 

1.11 

0.38 

0.00 

0.22 

0.94 

30253 

0.00 

41 

41 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

30254 

-2.45 

54 

51 

0.61 

0.67 

-0.59 

0.20 

-1.23 

0.00 

0.55 

1.21 

30255 

-3.96 

54 

53 

1.03 

0.94 

0.24 

0.22 

-0.37 

0.00 

0.24 

1.08 

30256 

-3.37 

42 

41 

1.02 

1.05 

0.37 

1.83 

0.95 

0.00 

-0.01 

0.92 

30257 

-0.51 

36 

28 

0.43 

1.24 

1.01 

1.15 

0.53 

0.00 

0.14 

0.74 

30258 

-2.70 

47 

45 

0.73 

0.97 

0.17 

0.57 

-0.20 

0.00 

0.20 

1.04 

30259 

-3.46 

45 

43 

1.03 

1.11 

0.42 

9.86 

2.91 

0.00 

0.34 

0.74 

30260 

0.00 

46 

45 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

30261 

0.00 

45 

44 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

30262 

-3.48 

38 

37 

1.05 

1.04 

0.34 

0.37 

-0.12 

0.00 

0.25 

1.04 

30263 

-2.02 

54 

49 

0.50 

1.06 

0.28 

0.98 

0.23 

0.00 

0.23 

0.95 

30264 

0.00 

42 

42 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

30265 

0.00 

38 

38 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

30266 

0.00 

41 

41 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

30267 

-2.52 

36 

34 

0.75 

1.18 

0.48 

1.53 

0.79 

0.00 

0.00 

0.86 

30268 

-2.26 

48 

45 

0.62 

0.81 

-0.25 

0.36 

-0.64 

0.00 

0.42 

1.15 

30269 

-1.58 

40 

35 

0.51 

0.88 

-0.23 

0.80 

-0.24 

0.00 

0.43 

1.08 

30270 

-1.83 

54 

47 

0.45 

0.78 

-0.72 

0.44 

-0.95 

0.00 

0.55 

1.22 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30271 

0.00 

39 

39 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

30272 

-3.30 

46 

45 

1.02 

0.95 

0.26 

0.35 

-0.15 

0.00 

0.23 

1.06 

30273 

-3.94 

50 

49 

1.04 

1.12 

0.43 

0.84 

0.35 

0.00 

0.11 

0.95 

30274 

0.00 

43 

43 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

30275 

-0.01 

44 

29 

0.35 

1.08 

0.56 

1.03 

0.19 

0.00 

0.34 

0.86 

30276 

-2.09 

41 

37 

0.56 

0.76 

-0.54 

0.74 

-0.17 

0.00 

0.49 

1.15 

30277 

-2.38 

57 

53 

0.54 

0.93 

-0.04 

0.72 

-0.17 

0.00 

0.32 

1.05 

30278 

-2.94 

57 

55 

0.73 

1.03 

0.25 

3.19 

1.68 

0.00 

0.02 

0.91 

30279 

-2.74 

55 

53 

0.74 

0.80 

-0.13 

0.29 

-0.80 

0.00 

0.42 

1.13 

30280 

-3.88 

57 

56 

1.02 

1.04 

0.36 

1.56 

0.81 

0.00 

-0.01 

0.94 

30281 

-2.58 

57 

54 

0.63 

0.71 

-0.49 

0.47 

-0.50 

0.00 

0.49 

1.15 

30282 

-3.47 

58 

57 

1.02 

1.06 

0.38 

4.34 

1.85 

0.00 

-0.16 

0.86 

30283 

-2.66 

57 

54 

0.62 

0.85 

-0.16 

0.37 

-0.57 

0.00 

0.39 

1.12 

30284 

-2.86 

57 

55 

0.73 

1.00 

0.21 

0.54 

-0.26 

0.00 

0.20 

1.03 

30285 

-2.51 

49 

46 

0.62 

0.98 

0.12 

0.53 

-0.46 

0.00 

0.32 

1.06 

30286 

-3.11 

62 

60 

0.74 

0.76 

-0.20 

0.27 

-0.68 

0.00 

0.40 

1.13 

30287 

-4.10 

55 

54 

1.03 

1.09 

0.40 

0.91 

0.41 

0.00 

0.10 

0.94 

30288 

-2.27 

60 

55 

0.50 

1.16 

0.54 

2.18 

1.45 

0.00 

0.10 

0.79 

30289 

-0.94 

52 

44 

0.41 

0.92 

-0.24 

0.88 

-0.15 

0.00 

0.38 

1.08 

30290 

-0.72 

53 

43 

0.37 

0.97 

-0.09 

0.89 

-0.20 

0.00 

0.35 

1.05 

30291 

-0.86 

59 

46 

0.34 

1.00 

0.04 

0.92 

-0.17 

0.00 

0.41 

1.02 

30292 

3.24 

66 

7 

0.42 

1.24 

0.87 

2.22 

2.05 

0.00 

-0.13 

0.69 

30293 

3.39 

53 

6 

0.48 

1.16 

0.57 

2.22 

1.62 

0.00 

0.20 

0.81 

30294 

1.44 

62 

22 

0.29 

1.13 

1.10 

1.60 

2.58 

0.00 

0.24 

0.54 

30295 

2.76 

54 

7 

0.43 

1.13 

0.53 

1.59 

1.21 

0.00 

0.14 

0.85 

30296 

0.89 

60 

28 

0.29 

1.04 

0.39 

1.09 

0.57 

0.00 

0.38 

0.84 

30297 

-0.22 

54 

35 

0.32 

1.06 

0.46 

1.08 

0.45 

0.00 

0.36 

0.86 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30298 

0.22 

60 

36 

0.29 

1.47 

3.79 

2.31 

5.34 

0.00 

-0.10 

-0.61 

30299 

1.15 

53 

19 

0.32 

1.06 

0.47 

1.06 

0.31 

0.00 

0.40 

0.86 

30300 

-0.27 

53 

37 

0.33 

1.00 

0.03 

1.00 

0.09 

0.00 

0.39 

0.99 

30302 

-0.84 

56 

46 

0.37 

0.95 

-0.16 

0.79 

-0.42 

0.00 

0.37 

1.08 

30303 

-0.83 

56 

41 

0.34 

0.77 

-1.51 

0.61 

-1.16 

0.00 

0.59 

1.39 

30304 

-0.72 

59 

42 

0.32 

0.86 

-0.87 

0.73 

-1.01 

0.00 

0.55 

1.25 

30305 

-1.17 

58 

48 

0.37 

0.99 

0.02 

0.74 

-0.58 

0.00 

0.40 

1.06 

30306 

-0.45 

57 

43 

0.33 

0.96 

-0.15 

0.93 

-0.18 

0.00 

0.41 

1.05 

30307 

-0.44 

57 

42 

0.33 

1.05 

0.41 

1.50 

1.49 

0.00 

0.30 

0.78 

30308 

-0.52 

53 

41 

0.35 

1.08 

0.48 

1.27 

0.87 

0.00 

0.25 

0.84 

30309 

-1.97 

42 

38 

0.56 

0.97 

0.06 

0.88 

0.08 

0.00 

0.34 

1.01 

30310 

-0.37 

56 

41 

0.33 

0.90 

-0.58 

0.74 

-0.87 

0.00 

0.49 

1.20 

30311 

-0.72 

57 

44 

0.34 

1.02 

0.15 

0.79 

-0.59 

0.00 

0.36 

1.05 

30312 

-0.89 

57 

43 

0.36 

0.94 

-0.25 

0.80 

-0.54 

0.00 

0.51 

1.10 

30313 

0.12 

57 

39 

0.32 

1.16 

1.09 

1.22 

0.92 

0.00 

0.30 

0.69 

30314 

-1.17 

56 

44 

0.35 

0.85 

-0.77 

0.95 

-0.07 

0.00 

0.45 

1.16 

30315 

-0.47 

52 

37 

0.34 

0.92 

-0.42 

0.81 

-0.54 

0.00 

0.49 

1.15 

30316 

-0.62 

57 

42 

0.33 

0.91 

-0.51 

0.87 

-0.25 

0.00 

0.47 

1.13 

30317 

-1.07 

59 

47 

0.36 

1.12 

0.62 

1.36 

0.93 

0.00 

0.30 

0.82 

30318 

-0.12 

58 

38 

0.31 

0.79 

-1.59 

0.64 

-1.76 

0.00 

0.63 

1.45 

30319 

-0.89 

57 

45 

0.35 

0.88 

-0.63 

0.70 

-0.85 

0.00 

0.49 

1.19 

30320 

0.90 

54 

25 

0.31 

1.02 

0.22 

1.14 

0.68 

0.00 

0.43 

0.90 

30321 

1.38 

60 

20 

0.30 

0.99 

-0.06 

1.04 

0.24 

0.00 

0.41 

1.01 

30322 

2.56 

57 

12 

0.35 

1.08 

0.46 

2.09 

1.89 

0.00 

0.22 

0.75 

30323 

1.63 

48 

15 

0.34 

1.12 

0.86 

1.22 

0.96 

0.00 

0.24 

0.72 

30324 

0.60 

51 

23 

0.32 

0.83 

-1.49 

0.75 

-0.70 

0.00 

0.55 

1.50 

30325 

0.62 

60 

30 

0.31 

0.93 

-0.48 

0.83 

-0.71 

0.00 

0.58 

1.17 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30326 

0.30 

59 

33 

0.29 

1.16 

1.46 

1.19 

1.27 

0.00 

0.26 

0.51 

30327 

-0.06 

48 

31 

0.33 

0.99 

-0.07 

0.87 

-0.53 

0.00 

0.42 

1.10 

30328 

0.61 

49 

24 

0.33 

1.25 

1.79 

1.30 

1.20 

0.00 

0.32 

0.39 

30329 

1.42 

299 

179 

0.14 

1.00 

0.07 

1.02 

0.22 

0.00 

0.48 

0.99 

30330 

2.82 

51 

8 

0.42 

1.17 

0.76 

2.90 

2.58 

0.00 

0.15 

0.72 

30331 

2.21 

57 

13 

0.33 

1.09 

0.57 

1.34 

1.01 

0.00 

0.16 

0.79 

30332 

0.67 

59 

30 

0.29 

0.95 

-0.39 

0.94 

-0.34 

0.00 

0.47 

1.13 

30333 

0.67 

55 

30 

0.31 

0.71 

-2.50 

0.63 

-1.93 

0.00 

0.68 

1.70 

30334 

0.59 

51 

26 

0.31 

1.28 

2.18 

1.35 

1.70 

0.00 

0.22 

0.21 

30335 

0.12 

58 

36 

0.30 

0.86 

-1.18 

0.73 

-1.03 

0.00 

0.55 

1.38 

30336 

-0.90 

57 

45 

0.37 

0.82 

-0.87 

0.60 

-1.02 

0.00 

0.53 

1.24 

30337 

0.69 

54 

29 

0.31 

0.99 

-0.07 

0.90 

-0.40 

0.00 

0.46 

1.08 

30338 

-1.30 

57 

47 

0.38 

1.03 

0.20 

0.81 

-0.36 

0.00 

0.38 

1.02 

30339 

0.62 

57 

33 

0.30 

1.14 

1.17 

1.14 

0.69 

0.00 

0.33 

0.63 

30340 

-1.45 

60 

52 

0.41 

0.84 

-0.58 

0.54 

-0.72 

0.00 

0.48 

1.18 

30341 

0.45 

60 

33 

0.29 

0.89 

-1.03 

0.85 

-0.83 

0.00 

0.53 

1.32 

30342 

-0.47 

60 

42 

0.30 

0.81 

-1.44 

0.69 

-1.24 

0.00 

0.54 

1.42 

30343 

0.41 

56 

32 

0.30 

0.93 

-0.67 

0.88 

-0.63 

0.00 

0.45 

1.25 

30344 

-1.06 

61 

50 

0.37 

0.96 

-0.11 

0.72 

-0.56 

0.00 

0.46 

1.08 

30345 

0.23 

51 

29 

0.31 

0.83 

-1.60 

0.79 

-1.25 

0.00 

0.56 

1.54 

30346 

-1.13 

57 

47 

0.40 

0.85 

-0.53 

0.73 

-0.54 

0.00 

0.55 

1.14 

30347 

0.43 

59 

34 

0.29 

1.04 

0.41 

0.99 

0.01 

0.00 

0.35 

0.90 

30348 

-0.82 

52 

40 

0.37 

1.00 

0.07 

0.81 

-0.50 

0.00 

0.46 

1.05 

30349 

0.61 

55 

30 

0.30 

1.02 

0.19 

0.94 

-0.15 

0.00 

0.42 

0.99 

30350 

-0.97 

57 

46 

0.37 

0.93 

-0.26 

0.72 

-0.75 

0.00 

0.51 

1.12 

30351 

1.11 

57 

23 

0.30 

1.37 

2.85 

1.51 

2.30 

0.00 

0.17 

0.01 

30352 

0.95 

57 

25 

0.31 

1.06 

0.54 

1.21 

1.08 

0.00 

0.41 

0.79 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30353 

1.18 

56 

23 

0.30 

1.14 

1.11 

1.21 

1.17 

0.00 

0.32 

0.63 

30354 

-0.57 

53 

40 

0.36 

1.15 

0.83 

1.07 

0.32 

0.00 

0.35 

0.84 

30355 

2.71 

57 

10 

0.38 

1.25 

1.09 

1.82 

1.46 

0.00 

0.14 

0.66 

30356 

1.90 

56 

16 

0.33 

1.15 

0.92 

1.47 

1.52 

0.00 

0.29 

0.68 

30357 

-0.86 

76 

60 

0.31 

0.99 

-0.01 

0.81 

-0.46 

0.00 

0.45 

1.05 

30358 

-2.46 

57 

53 

0.61 

0.93 

0.02 

1.21 

0.51 

0.00 

0.37 

1.01 

30359 

0.45 

56 

32 

0.30 

1.04 

0.35 

1.04 

0.24 

0.00 

0.42 

0.90 

30360 

-0.73 

55 

43 

0.34 

1.07 

0.45 

1.15 

0.57 

0.00 

0.20 

0.86 

30361 

-1.71 

75 

66 

0.40 

0.87 

-0.38 

0.56 

-0.85 

0.00 

0.52 

1.13 

30362 

-1.47 

67 

59 

0.40 

0.90 

-0.29 

0.72 

-0.44 

0.00 

0.41 

1.09 

30363 

-1.07 

66 

54 

0.36 

1.03 

0.22 

0.76 

-0.48 

0.00 

0.43 

1.02 

30364 

-0.87 

47 

37 

0.38 

1.02 

0.18 

0.90 

-0.14 

0.00 

0.33 

0.99 

30365 

-0.18 

55 

36 

0.31 

0.89 

-0.87 

0.77 

-0.84 

0.00 

0.50 

1.31 

30366 

-1.42 

64 

54 

0.39 

0.69 

-1.31 

0.44 

-1.32 

0.00 

0.64 

1.29 

30367 

-0.44 

62 

46 

0.32 

0.95 

-0.28 

0.92 

-0.21 

0.00 

0.43 

1.08 

30368 

-2.66 

56 

52 

0.56 

1.03 

0.21 

0.76 

-0.04 

0.00 

0.33 

1.02 

30369 

-1.18 

56 

47 

0.39 

0.84 

-0.63 

0.68 

-0.65 

0.00 

0.46 

1.17 

30370 

-1.53 

56 

48 

0.43 

0.81 

-0.61 

0.54 

-0.75 

0.00 

0.55 

1.18 

30371 

3.36 

71 

9 

0.39 

1.12 

0.51 

1.91 

1.56 

0.00 

0.22 

0.85 

30372 

0.29 

273 

217 

0.17 

1.17 

1.85 

1.12 

0.64 

0.00 

0.32 

0.81 

30373 

2.04 

401 

189 

0.12 

0.83 

-3.68 

0.80 

-2.41 

0.00 

0.60 

1.38 

30374 

0.25 

56 

33 

0.31 

1.00 

0.06 

0.91 

-0.34 

0.00 

0.46 

1.04 

30375 

1.78 

58 

17 

0.32 

1.26 

1.63 

1.34 

1.08 

0.00 

0.20 

0.52 

30376 

0.84 

53 

25 

0.31 

0.98 

-0.13 

0.94 

-0.23 

0.00 

0.48 

1.07 

30377 

2.45 

57 

11 

0.38 

0.94 

-0.18 

0.97 

0.10 

0.00 

0.45 

1.04 

30378 

2.29 

56 

14 

0.38 

0.92 

-0.32 

0.80 

-0.43 

0.00 

0.61 

1.10 

30379 

2.33 

58 

12 

0.35 

1.09 

0.51 

1.42 

1.08 

0.00 

0.28 

0.83 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30380 

2.41 

55 

10 

0.39 

1.12 

0.57 

2.50 

2.53 

0.00 

0.23 

0.75 

30381 

-0.49 

62 

48 

0.33 

1.18 

1.02 

1.67 

1.98 

0.00 

0.12 

0.65 

30382 

-0.64 

57 

45 

0.35 

0.87 

-0.65 

0.69 

-0.86 

0.00 

0.46 

1.20 

30383 

-1.04 

54 

43 

0.37 

0.95 

-0.19 

0.90 

-0.19 

0.00 

0.39 

1.06 

30384 

-1.44 

55 

47 

0.42 

0.82 

-0.62 

0.56 

-0.75 

0.00 

0.51 

1.19 

30385 

-1.23 

59 

48 

0.37 

0.85 

-0.65 

0.64 

-0.80 

0.00 

0.50 

1.19 

30386 

-1.09 

56 

47 

0.40 

0.90 

-0.32 

0.65 

-0.85 

0.00 

0.44 

1.14 

30387 

-0.88 

57 

46 

0.36 

1.06 

0.36 

2.50 

3.10 

0.00 

0.18 

0.80 

30388 

-0.74 

56 

42 

0.34 

1.12 

0.73 

1.09 

0.39 

0.00 

0.33 

0.83 

30389 

0.58 

55 

30 

0.32 

0.90 

-0.78 

0.80 

-0.85 

0.00 

0.57 

1.26 

30390 

3.79 

59 

4 

0.53 

1.15 

0.49 

1.97 

1.35 

0.00 

-0.08 

0.82 

30391 

-0.19 

56 

37 

0.32 

1.07 

0.55 

1.61 

2.17 

0.00 

0.37 

0.71 

30392 

0.76 

274 

179 

0.15 

1.07 

1.20 

1.03 

0.32 

0.00 

0.42 

0.86 

30393 

0.57 

74 

41 

0.26 

1.15 

1.46 

1.11 

0.70 

0.00 

0.34 

0.62 

30394 

0.00 

307 

245 

0.16 

1.00 

0.07 

0.93 

-0.33 

0.00 

0.39 

1.00 

30395 

2.74 

56 

8 

0.42 

0.95 

-0.08 

0.96 

0.12 

0.00 

0.40 

1.03 

30396 

1.77 

57 

20 

0.30 

0.97 

-0.24 

0.97 

-0.10 

0.00 

0.41 

1.07 

30397 

2.30 

56 

13 

0.37 

1.13 

0.67 

1.30 

0.84 

0.00 

0.39 

0.81 

30398 

1.54 

57 

20 

0.30 

1.04 

0.37 

1.10 

0.55 

0.00 

0.35 

0.88 

30399 

0.53 

71 

38 

0.27 

1.07 

0.65 

1.02 

0.20 

0.00 

0.42 

0.86 

30400 

1.66 

58 

19 

0.31 

1.02 

0.16 

1.01 

0.13 

0.00 

0.39 

0.97 

30401 

-3.54 

45 

44 

1.03 

0.79 

0.06 

0.14 

-0.54 

0.00 

0.31 

1.14 

30402 

-1.27 

39 

33 

0.48 

0.80 

-0.64 

0.58 

-0.61 

0.00 

0.45 

1.22 

30403 

-2.19 

46 

42 

0.56 

0.76 

-0.51 

0.46 

-0.52 

0.00 

0.47 

1.17 

30404 

-1.76 

44 

40 

0.56 

1.11 

0.39 

1.48 

0.84 

0.00 

0.18 

0.91 

30405 

0.08 

40 

25 

0.36 

1.19 

1.25 

1.32 

1.09 

0.00 

0.27 

0.49 

30406 

-2.33 

46 

43 

0.62 

1.02 

0.20 

0.87 

0.15 

0.00 

0.21 

1.00 

easyCBM  CCSS  Third  Grade  Math  Measure  Development 


179 

Appendix  D:  Item  Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30407 

-0.23 

50 

35 

0.35 

0.98 

-0.06 

0.84 

-0.43 

0.00 

0.46 

1.07 

30408 

-1.92 

49 

45 

0.53 

1.03 

0.22 

0.94 

0.13 

0.00 

0.17 

0.98 

30409 

2.96 

55 

8 

0.42 

1.08 

0.39 

1.29 

0.72 

0.00 

0.28 

0.91 

30410 

-2.69 

36 

33 

0.69 

1.47 

0.95 

0.94 

0.32 

0.00 

0.25 

0.82 

30411 

-2.68 

47 

45 

0.74 

0.97 

0.16 

0.50 

-0.23 

0.00 

0.24 

1.05 

30412 

-1.71 

58 

52 

0.45 

1.10 

0.41 

1.39 

0.77 

0.00 

0.17 

0.90 

30413 

-1.71 

42 

38 

0.54 

0.99 

0.12 

0.69 

-0.21 

0.00 

0.26 

1.04 

30414 

0.47 

68 

35 

0.27 

0.91 

-0.88 

0.88 

-0.72 

0.00 

0.53 

1.25 

30415 

-3.36 

48 

47 

1.02 

0.91 

0.22 

0.26 

-0.35 

0.00 

0.29 

1.08 

30416 

-1.17 

47 

40 

0.43 

1.01 

0.11 

0.80 

-0.35 

0.00 

0.30 

1.03 

30417 

0.81 

44 

24 

0.34 

1.06 

0.49 

1.08 

0.45 

0.00 

0.40 

0.82 

30418 

-0.53 

57 

42 

0.34 

1.13 

0.76 

0.94 

0.01 

0.00 

0.40 

0.87 

30419 

-1.04 

33 

27 

0.52 

1.15 

0.57 

1.32 

0.64 

0.00 

0.39 

0.80 

30420 

-0.10 

36 

24 

0.38 

1.08 

0.55 

1.05 

0.29 

0.00 

0.27 

0.83 

30421 

-0.60 

50 

38 

0.36 

0.84 

-0.96 

0.73 

-0.72 

0.00 

0.48 

1.27 

30422 

-1.35 

35 

30 

0.51 

0.88 

-0.26 

0.75 

-0.25 

0.00 

0.38 

1.11 

30423 

1.02 

51 

26 

0.31 

1.06 

0.54 

0.98 

-0.05 

0.00 

0.41 

0.89 

30424 

-1.79 

51 

45 

0.46 

0.95 

-0.07 

0.70 

-0.30 

0.00 

0.34 

1.06 

30425 

-0.90 

55 

45 

0.37 

1.18 

0.86 

1.23 

0.74 

0.00 

0.12 

0.79 

30426 

-1.21 

59 

50 

0.39 

0.75 

-1.08 

0.47 

-1.35 

0.00 

0.57 

1.27 

30427 

-1.58 

57 

49 

0.42 

1.26 

0.94 

1.99 

1.82 

0.00 

0.09 

0.71 

30428 

-2.43 

57 

53 

0.54 

1.03 

0.21 

1.00 

0.26 

0.00 

0.25 

0.99 

30429 

-2.16 

57 

52 

0.49 

1.04 

0.23 

1.28 

0.60 

0.00 

0.21 

0.94 

30430 

-1.15 

57 

47 

0.37 

1.15 

0.76 

0.99 

0.16 

0.00 

0.22 

0.85 

30431 

-1.57 

53 

47 

0.45 

0.88 

-0.31 

0.53 

-0.76 

0.00 

0.39 

1.14 

30432 

-0.80 

57 

44 

0.34 

1.12 

0.72 

1.18 

0.69 

0.00 

0.21 

0.82 

30433 

-1.34 

54 

44 

0.38 

1.04 

0.24 

1.00 

0.12 

0.00 

0.32 

0.97 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30434 

-1.64 

60 

53 

0.43 

1.05 

0.28 

0.87 

-0.02 

0.00 

0.28 

0.97 

30435 

-1.38 

55 

47 

0.40 

1.17 

0.74 

1.41 

0.95 

0.00 

0.14 

0.81 

30436 

-1.31 

60 

52 

0.41 

1.17 

0.69 

3.84 

3.52 

0.00 

0.11 

0.75 

30437 

-1.07 

57 

47 

0.39 

1.07 

0.36 

0.83 

-0.25 

0.00 

0.40 

0.98 

30438 

-1.98 

57 

52 

0.49 

1.07 

0.32 

0.78 

-0.10 

0.00 

0.25 

0.98 

30439 

-1.62 

67 

56 

0.36 

0.97 

-0.05 

0.88 

-0.15 

0.00 

0.39 

1.04 

30440 

-0.33 

57 

39 

0.31 

0.84 

-1.28 

0.74 

-1.17 

0.00 

0.53 

1.38 

30441 

-0.82 

60 

47 

0.36 

0.81 

-0.89 

0.73 

-0.63 

0.00 

0.57 

1.20 

30442 

0.22 

56 

35 

0.31 

0.74 

-2.09 

0.67 

-1.86 

0.00 

0.65 

1.58 

30443 

-0.45 

281 

229 

0.17 

0.90 

-1.04 

0.80 

-1.03 

0.00 

0.46 

1.11 

30444 

-0.32 

57 

42 

0.33 

0.72 

-1.97 

0.59 

-1.55 

0.00 

0.62 

1.48 

30445 

0.14 

58 

40 

0.31 

1.00 

0.08 

1.04 

0.28 

0.00 

0.41 

0.98 

30446 

-0.42 

56 

39 

0.33 

0.82 

-1.06 

0.66 

-1.18 

0.00 

0.61 

1.31 

30447 

0.34 

57 

34 

0.30 

0.82 

-1.62 

0.70 

-1.58 

0.00 

0.58 

1.53 

30448 

-1.88 

57 

51 

0.47 

0.97 

0.02 

0.66 

-0.34 

0.00 

0.35 

1.05 

30449 

0.58 

56 

28 

0.30 

0.88 

-0.95 

0.81 

-0.78 

0.00 

0.55 

1.32 

30450 

-1.20 

57 

48 

0.39 

0.85 

-0.57 

0.57 

-0.97 

0.00 

0.51 

1.19 

30451 

1.01 

59 

30 

0.29 

0.85 

-1.63 

0.78 

-1.70 

0.00 

0.54 

1.59 

30452 

0.55 

54 

30 

0.30 

1.03 

0.31 

1.05 

0.34 

0.00 

0.40 

0.91 

30453 

0.94 

54 

21 

0.32 

0.86 

-1.01 

0.77 

-0.97 

0.00 

0.58 

1.31 

30454 

0.83 

52 

24 

0.30 

0.98 

-0.14 

0.93 

-0.42 

0.00 

0.40 

1.11 

30455 

0.61 

60 

35 

0.28 

0.90 

-1.12 

0.88 

-0.73 

0.00 

0.46 

1.37 

30456 

0.89 

54 

26 

0.31 

0.95 

-0.37 

0.97 

-0.12 

0.00 

0.47 

1.11 

30457 

-1.71 

293 

279 

0.28 

0.96 

-0.11 

0.64 

-0.77 

0.00 

0.25 

1.04 

30458 

-1.58 

49 

42 

0.44 

0.91 

-0.22 

0.73 

-0.44 

0.00 

0.45 

1.10 

30459 

-0.18 

44 

30 

0.36 

0.94 

-0.28 

0.87 

-0.30 

0.00 

0.49 

1.11 

30460 

1.97 

58 

14 

0.32 

0.94 

-0.36 

0.98 

0.01 

0.00 

0.38 

1.08 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30461 

0.28 

58 

35 

0.30 

0.96 

-0.37 

0.85 

-0.67 

0.00 

0.47 

1.17 

30462 

0.26 

53 

31 

0.31 

0.94 

-0.47 

0.87 

-0.58 

0.00 

0.49 

1.19 

30463 

1.54 

54 

20 

0.32 

1.05 

0.46 

1.03 

0.22 

0.00 

0.38 

0.87 

30464 

1.74 

52 

16 

0.33 

0.91 

-0.56 

0.80 

-0.47 

0.00 

0.45 

1.21 

30465 

1.38 

57 

21 

0.30 

0.94 

-0.47 

0.89 

-0.58 

0.00 

0.47 

1.17 

30466 

0.18 

58 

39 

0.30 

1.10 

0.74 

1.38 

1.79 

0.00 

0.28 

0.74 

30467 

1.06 

56 

25 

0.30 

0.82 

-1.46 

0.76 

-1.58 

0.00 

0.60 

1.46 

30468 

3.45 

53 

6 

0.50 

1.19 

0.63 

1.25 

0.57 

0.00 

0.27 

0.85 

30469 

2.12 

48 

13 

0.37 

0.81 

-1.05 

0.79 

-0.62 

0.00 

0.58 

1.26 

30470 

2.46 

56 

10 

0.38 

0.98 

-0.02 

1.03 

0.22 

0.00 

0.35 

1.00 

30471 

0.72 

55 

26 

0.29 

0.85 

-1.49 

0.83 

-1.29 

0.00 

0.54 

1.52 

30472 

0.89 

57 

25 

0.30 

0.93 

-0.63 

0.82 

-0.44 

0.00 

0.46 

1.27 

30473 

0.97 

58 

26 

0.29 

0.99 

-0.03 

0.93 

-0.43 

0.00 

0.42 

1.07 

30474 

1.35 

56 

20 

0.31 

1.02 

0.17 

0.93 

-0.04 

0.00 

0.39 

0.99 

30475 

1.05 

56 

24 

0.30 

1.33 

2.62 

1.42 

2.26 

0.00 

0.13 

0.07 

30476 

-1.52 

55 

48 

0.43 

1.04 

0.24 

1.07 

0.31 

0.00 

0.23 

0.96 

30477 

-0.70 

57 

40 

0.32 

1.01 

0.14 

0.89 

-0.32 

0.00 

0.44 

1.02 

30478 

-1.40 

53 

45 

0.41 

1.08 

0.41 

1.12 

0.39 

0.00 

0.23 

0.90 

30479 

0.45 

49 

27 

0.33 

0.82 

-1.31 

0.77 

-0.94 

0.00 

0.60 

1.40 

30480 

0.55 

55 

29 

0.30 

0.98 

-0.19 

0.90 

-0.31 

0.00 

0.47 

1.11 

30481 

0.46 

56 

32 

0.30 

0.96 

-0.31 

0.86 

-0.50 

0.00 

0.46 

1.17 

30482 

-0.19 

57 

40 

0.32 

1.07 

0.48 

0.95 

-0.06 

0.00 

0.40 

0.92 

30483 

0.29 

57 

32 

0.29 

0.97 

-0.25 

0.98 

-0.12 

0.00 

0.43 

1.09 

30484 

0.27 

55 

31 

0.30 

1.17 

1.47 

1.13 

0.59 

0.00 

0.31 

0.54 

30485 

2.25 

59 

12 

0.36 

0.97 

-0.08 

1.14 

0.48 

0.00 

0.41 

1.02 

30486 

1.56 

57 

21 

0.31 

0.80 

-1.58 

0.74 

-1.20 

0.00 

0.60 

1.43 

30487 

0.65 

61 

32 

0.29 

1.10 

0.86 

1.05 

0.35 

0.00 

0.40 

0.78 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30488 

1.58 

58 

16 

0.31 

0.98 

-0.07 

0.95 

-0.06 

0.00 

0.33 

1.04 

30489 

1.47 

56 

17 

0.32 

0.92 

-0.54 

0.76 

-0.65 

0.00 

0.49 

1.21 

30490 

1.24 

57 

26 

0.30 

1.08 

0.68 

1.28 

1.33 

0.00 

0.37 

0.71 

30491 

1.14 

55 

22 

0.30 

0.97 

-0.23 

0.95 

-0.27 

0.00 

0.41 

1.09 

30492 

1.22 

52 

20 

0.31 

0.96 

-0.29 

0.88 

-0.58 

0.00 

0.45 

1.14 

30493 

-0.75 

53 

40 

0.34 

0.96 

-0.18 

0.79 

-0.60 

0.00 

0.42 

1.11 

30494 

0.15 

57 

34 

0.31 

1.12 

0.98 

1.03 

0.20 

0.00 

0.40 

0.77 

30495 

0.61 

56 

28 

0.30 

1.00 

0.01 

0.97 

-0.04 

0.00 

0.46 

1.01 

30496 

-0.23 

55 

36 

0.30 

1.05 

0.46 

1.00 

0.06 

0.00 

0.32 

0.90 

30497 

-0.49 

61 

45 

0.31 

1.09 

0.66 

0.97 

-0.02 

0.00 

0.30 

0.88 

30498 

0.55 

57 

35 

0.30 

0.98 

-0.14 

0.88 

-0.52 

0.00 

0.43 

1.11 

30499 

0.14 

56 

33 

0.31 

1.16 

1.29 

1.32 

1.67 

0.00 

0.31 

0.53 

30500 

-0.63 

54 

40 

0.36 

0.95 

-0.23 

0.83 

-0.33 

0.00 

0.52 

1.09 

30501 

1.34 

272 

165 

0.14 

1.19 

2.98 

1.23 

1.88 

0.00 

0.38 

0.60 

30502 

-0.29 

55 

38 

0.33 

1.17 

1.15 

1.51 

1.62 

0.00 

0.29 

0.62 

30503 

-1.47 

56 

49 

0.43 

0.92 

-0.18 

0.70 

-0.42 

0.00 

0.39 

1.08 

30504 

-0.38 

55 

39 

0.32 

1.09 

0.66 

1.01 

0.13 

0.00 

0.30 

0.85 

30505 

0.48 

54 

30 

0.31 

0.88 

-0.97 

0.83 

-0.90 

0.00 

0.56 

1.31 

30506 

0.32 

55 

31 

0.30 

1.06 

0.56 

1.08 

0.48 

0.00 

0.37 

0.81 

30507 

-0.69 

72 

56 

0.31 

1.00 

0.08 

0.81 

-0.56 

0.00 

0.42 

1.04 

30508 

0.57 

56 

31 

0.31 

0.89 

-0.88 

0.81 

-0.64 

0.00 

0.55 

1.28 

30509 

-1.44 

393 

368 

0.22 

0.97 

-0.13 

0.78 

-0.51 

0.00 

0.31 

1.04 

30510 

0.45 

60 

33 

0.29 

1.02 

0.26 

0.98 

-0.10 

0.00 

0.41 

0.96 

30511 

-1.50 

47 

41 

0.49 

0.87 

-0.29 

0.72 

-0.29 

0.00 

0.51 

1.11 

30512 

-1.67 

49 

44 

0.49 

0.90 

-0.18 

0.90 

0.05 

0.00 

0.33 

1.06 

30513 

-1.66 

50 

44 

0.46 

1.14 

0.53 

1.05 

0.26 

0.00 

0.18 

0.90 

30514 

-1.02 

55 

46 

0.38 

1.07 

0.36 

1.03 

0.20 

0.00 

0.23 

0.93 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30515 

-0.99 

51 

42 

0.38 

0.79 

-0.91 

0.70 

-0.76 

0.00 

0.49 

1.23 

30516 

-0.99 

50 

41 

0.40 

0.98 

0.00 

0.92 

-0.01 

0.00 

0.38 

1.03 

30517 

-1.50 

46 

39 

0.46 

0.94 

-0.10 

0.72 

-0.36 

0.00 

0.47 

1.08 

30518 

-2.19 

35 

33 

0.75 

1.07 

0.31 

0.78 

0.22 

0.00 

0.19 

0.98 

30519 

-1.07 

43 

36 

0.43 

1.03 

0.19 

0.82 

-0.33 

0.00 

0.30 

1.02 

30520 

-1.76 

45 

40 

0.52 

0.99 

0.09 

0.61 

-0.59 

0.00 

0.45 

1.07 

30521 

0.81 

64 

32 

0.29 

1.05 

0.49 

1.14 

0.85 

0.00 

0.43 

0.83 

30522 

1.85 

62 

19 

0.30 

0.92 

-0.58 

0.94 

-0.17 

0.00 

0.46 

1.15 

30523 

0.88 

68 

32 

0.27 

1.15 

1.41 

1.13 

0.88 

0.00 

0.32 

0.60 

30524 

4.02 

56 

4 

0.54 

1.05 

0.26 

3.99 

2.39 

0.00 

0.12 

0.88 

30525 

-2.35 

56 

52 

0.53 

0.91 

-0.08 

0.53 

-0.45 

0.00 

0.30 

1.09 

30526 

-1.17 

52 

45 

0.43 

1.01 

0.12 

0.74 

-0.38 

0.00 

0.33 

1.03 

30527 

-0.21 

56 

40 

0.32 

0.87 

-0.91 

0.72 

-1.03 

0.00 

0.50 

1.29 

30528 

-1.69 

294 

279 

0.28 

0.96 

-0.13 

0.60 

-0.92 

0.00 

0.29 

1.05 

30529 

-0.72 

62 

47 

0.31 

0.86 

-0.90 

0.72 

-1.04 

0.00 

0.47 

1.26 

30530 

0.39 

54 

27 

0.31 

0.92 

-0.59 

0.93 

-0.18 

0.00 

0.50 

1.17 

30531 

1.46 

292 

160 

0.13 

0.87 

-2.40 

0.84 

-1.58 

0.00 

0.55 

1.31 

30532 

4.11 

56 

3 

0.61 

0.93 

0.02 

1.18 

0.49 

0.00 

0.22 

1.02 

30533 

2.63 

54 

12 

0.37 

1.10 

0.54 

1.44 

1.15 

0.00 

0.32 

0.82 

30534 

3.10 

56 

7 

0.46 

0.88 

-0.30 

0.72 

-0.30 

0.00 

0.50 

1.10 

30535 

0.41 

56 

34 

0.30 

0.93 

-0.56 

1.07 

0.41 

0.00 

0.45 

1.11 

30536 

-0.07 

56 

37 

0.31 

0.93 

-0.51 

0.85 

-0.53 

0.00 

0.47 

1.17 

30537 

3.07 

64 

8 

0.40 

1.14 

0.58 

1.82 

1.59 

0.00 

0.12 

0.82 

30538 

0.42 

61 

35 

0.29 

0.81 

-1.85 

0.72 

-1.36 

0.00 

0.58 

1.57 

30539 

-0.74 

55 

40 

0.35 

0.78 

-1.37 

0.59 

-1.10 

0.00 

0.58 

1.37 

30540 

-0.01 

61 

38 

0.30 

0.85 

-1.24 

0.71 

-1.34 

0.00 

0.56 

1.39 

30541 

2.30 

59 

12 

0.36 

1.49 

2.25 

2.36 

2.49 

0.00 

-0.03 

0.27 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30542 

-0.92 

63 

51 

0.34 

1.03 

0.22 

0.88 

-0.23 

0.00 

0.33 

0.99 

30543 

2.77 

57 

8 

0.40 

1.22 

0.89 

2.41 

2.28 

0.00 

-0.05 

0.65 

30544 

-2.38 

57 

53 

0.54 

0.79 

-0.44 

0.29 

-1.00 

0.00 

0.48 

1.18 

30545 

-1.41 

56 

47 

0.40 

0.79 

-0.82 

0.61 

-0.86 

0.00 

0.54 

1.21 

30546 

2.40 

55 

12 

0.36 

1.12 

0.68 

1.83 

1.57 

0.00 

0.20 

0.68 

30547 

-1.42 

60 

53 

0.43 

0.83 

-0.51 

0.77 

-0.31 

0.00 

0.44 

1.12 

30548 

2.48 

61 

11 

0.36 

1.16 

0.80 

1.97 

2.17 

0.00 

0.15 

0.74 

30549 

-1.65 

58 

51 

0.43 

0.91 

-0.24 

0.68 

-0.41 

0.00 

0.39 

1.09 

30550 

0.54 

56 

29 

0.31 

1.04 

0.37 

0.95 

-0.18 

0.00 

0.46 

0.95 

30551 

-3.41 

54 

52 

0.84 

0.70 

-0.20 

0.31 

-0.44 

0.00 

0.57 

1.12 

30552 

-1.77 

42 

38 

0.54 

0.97 

0.05 

0.70 

-0.26 

0.00 

0.28 

1.05 

30553 

-3.51 

41 

40 

1.02 

0.82 

0.10 

0.19 

-0.53 

0.00 

0.30 

1.13 

30554 

-0.82 

41 

33 

0.42 

1.05 

0.27 

0.85 

-0.19 

0.00 

0.34 

0.99 

30555 

-1.21 

51 

42 

0.39 

1.01 

0.13 

0.87 

-0.14 

0.00 

0.33 

1.01 

30556 

-1.68 

45 

39 

0.50 

1.06 

0.29 

0.84 

0.01 

0.00 

0.43 

0.97 

30557 

-1.53 

42 

37 

0.50 

0.81 

-0.50 

0.54 

-0.64 

0.00 

0.44 

1.18 

30558 

-2.50 

45 

43 

0.73 

1.04 

0.27 

1.90 

1.05 

0.00 

0.03 

0.93 

30559 

-1.36 

38 

33 

0.50 

0.83 

-0.43 

0.60 

-0.69 

0.00 

0.47 

1.16 

30560 

-1.74 

46 

41 

0.50 

0.78 

-0.57 

0.40 

-0.87 

0.00 

0.48 

1.21 

30561 

-0.55 

47 

35 

0.36 

1.00 

0.04 

1.46 

1.36 

0.00 

0.32 

0.92 

30562 

0.30 

49 

26 

0.32 

1.40 

2.92 

1.77 

3.39 

0.00 

0.09 

-0.23 

30563 

-2.09 

44 

41 

0.62 

1.05 

0.26 

1.09 

0.40 

0.00 

0.15 

0.95 

30564 

0.19 

48 

27 

0.33 

0.99 

-0.06 

0.93 

-0.23 

0.00 

0.45 

1.05 

30565 

0.01 

60 

43 

0.31 

1.02 

0.19 

0.92 

-0.21 

0.00 

0.39 

0.99 

30566 

-0.53 

56 

43 

0.35 

0.92 

-0.39 

0.77 

-0.63 

0.00 

0.49 

1.14 

30567 

1.18 

56 

24 

0.30 

1.32 

2.69 

1.42 

2.05 

0.00 

0.11 

-0.01 

30568 

0.09 

54 

37 

0.33 

0.89 

-0.70 

0.70 

-1.16 

0.00 

0.55 

1.26 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30569 

0.45 

57 

34 

0.30 

0.93 

-0.55 

0.85 

-0.52 

0.00 

0.50 

1.20 

30570 

-0.58 

56 

44 

0.34 

0.80 

-1.12 

0.62 

-1.51 

0.00 

0.56 

1.31 

30571 

-0.63 

59 

45 

0.34 

1.07 

0.43 

1.03 

0.22 

0.00 

0.38 

0.91 

30572 

-0.15 

58 

39 

0.31 

0.98 

-0.10 

0.90 

-0.43 

0.00 

0.43 

1.07 

30573 

0.57 

63 

36 

0.28 

0.98 

-0.18 

0.90 

-0.58 

0.00 

0.43 

1.12 

30574 

0.66 

55 

27 

0.30 

0.88 

-1.05 

0.86 

-0.66 

0.00 

0.54 

1.32 

30575 

0.72 

59 

34 

0.30 

1.15 

1.24 

1.11 

0.65 

0.00 

0.35 

0.66 

30576 

0.38 

59 

35 

0.30 

0.92 

-0.62 

0.85 

-0.71 

0.00 

0.51 

1.21 

30579 

-2.49 

49 

46 

0.61 

0.92 

0.00 

0.55 

-0.46 

0.00 

0.33 

1.08 

30580 

-1.08 

48 

39 

0.39 

1.11 

0.55 

1.78 

1.42 

0.00 

0.16 

0.77 

30583 

-1.86 

48 

44 

0.55 

1.01 

0.15 

2.65 

1.56 

0.00 

0.17 

0.89 

30584 

-1.44 

57 

49 

0.41 

0.92 

-0.21 

0.95 

0.07 

0.00 

0.37 

1.05 

30585 

-1.49 

58 

50 

0.40 

1.11 

0.48 

1.03 

0.23 

0.00 

0.22 

0.92 

30586 

0.52 

62 

36 

0.28 

1.21 

1.91 

1.25 

1.59 

0.00 

0.20 

0.37 

30587 

-1.57 

49 

43 

0.46 

0.98 

0.02 

0.89 

-0.02 

0.00 

0.32 

1.02 

30588 

-1.95 

62 

58 

0.53 

1.00 

0.15 

0.82 

-0.05 

0.00 

0.21 

1.01 

30589 

-3.17 

47 

45 

0.85 

1.74 

1.08 

1.58 

0.81 

0.00 

0.11 

0.75 

30590 

-2.58 

42 

40 

0.74 

1.01 

0.22 

0.66 

-0.05 

0.00 

0.23 

1.02 

30591 

-3.55 

50 

49 

1.03 

0.99 

0.30 

0.32 

-0.20 

0.00 

0.23 

1.05 

30592 

-2.46 

55 

51 

0.55 

1.23 

0.68 

1.78 

0.99 

0.00 

0.06 

0.78 

30593 

-0.84 

38 

30 

0.43 

1.21 

0.91 

1.17 

0.49 

0.00 

0.21 

0.76 

30594 

-2.14 

40 

38 

0.74 

1.04 

0.28 

0.84 

0.15 

0.00 

0.14 

0.98 

30595 

0.00 

35 

35 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

30596 

-0.92 

56 

44 

0.35 

0.82 

-0.99 

0.61 

-0.92 

0.00 

0.50 

1.28 

30597 

-1.51 

58 

50 

0.43 

0.80 

-0.66 

0.49 

-0.97 

0.00 

0.57 

1.19 

30598 

-1.89 

54 

48 

0.48 

1.08 

0.35 

1.31 

0.64 

0.00 

0.31 

0.91 

30599 

-0.85 

43 

35 

0.42 

0.94 

-0.19 

0.79 

-0.40 

0.00 

0.40 

1.09 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30600 

-1.48 

38 

34 

0.57 

1.13 

0.45 

0.87 

0.01 

0.00 

0.27 

0.96 

30601 

-3.40 

37 

36 

1.03 

0.95 

0.25 

0.35 

-0.16 

0.00 

0.25 

1.07 

30602 

-1.79 

40 

36 

0.55 

1.00 

0.12 

0.98 

0.18 

0.00 

0.25 

1.00 

30603 

-3.74 

48 

47 

1.03 

0.90 

0.19 

0.19 

-0.43 

0.00 

0.31 

1.10 

30604 

-2.65 

59 

56 

0.62 

0.78 

-0.33 

0.25 

-0.90 

0.00 

0.44 

1.16 

30605 

-0.92 

3037 

2432 

0.05 

0.93 

-2.49 

0.91 

-1.66 

0.00 

0.42 

1.09 

30606 

-1.28 

40 

33 

0.45 

0.67 

-1.27 

0.47 

-1.35 

0.00 

0.66 

1.35 

30607 

0.32 

47 

29 

0.34 

0.82 

-1.17 

0.80 

-0.72 

0.00 

0.59 

1.34 

30608 

-0.69 

45 

35 

0.38 

0.91 

-0.44 

0.77 

-0.56 

0.00 

0.44 

1.16 

30609 

-1.44 

33 

29 

0.55 

0.76 

-0.56 

0.46 

-0.68 

0.00 

0.47 

1.23 

30610 

-1.97 

56 

51 

0.49 

0.90 

-0.17 

0.95 

0.14 

0.00 

0.29 

1.05 

30611 

0.02 

50 

33 

0.33 

0.81 

-1.40 

0.67 

-0.99 

0.00 

0.57 

1.44 

30612 

-2.42 

54 

51 

0.62 

1.01 

0.19 

0.81 

0.06 

0.00 

0.25 

1.00 

30613 

-1.02 

45 

37 

0.41 

1.13 

0.61 

0.88 

-0.14 

0.00 

0.26 

0.92 

30614 

0.54 

64 

35 

0.28 

1.24 

1.95 

1.39 

2.22 

0.00 

0.24 

0.35 

30615 

0.11 

45 

29 

0.33 

1.10 

0.88 

1.14 

0.82 

0.00 

0.19 

0.66 

30616 

-1.89 

286 

272 

0.29 

0.92 

-0.29 

0.39 

-1.52 

0.00 

0.33 

1.09 

30617 

-2.21 

39 

37 

0.73 

0.97 

0.16 

1.06 

0.40 

0.00 

0.15 

1.00 

30618 

-1.49 

44 

37 

0.44 

0.99 

0.06 

0.81 

-0.26 

0.00 

0.34 

1.04 

30619 

-1.26 

38 

32 

0.46 

1.17 

0.67 

1.30 

0.78 

0.00 

0.02 

0.80 

30620 

-1.49 

54 

46 

0.41 

0.98 

0.01 

1.02 

0.20 

0.00 

0.35 

1.01 

30621 

-3.03 

47 

45 

1.02 

1.03 

0.34 

0.84 

0.32 

0.00 

0.52 

0.99 

30622 

-1.11 

3269 

2720 

0.05 

0.97 

-1.05 

0.92 

-1.30 

0.00 

0.38 

1.04 

30623 

-1.67 

67 

59 

0.40 

0.86 

-0.45 

0.60 

-0.73 

0.00 

0.44 

1.13 

30624 

-0.14 

56 

40 

0.32 

0.77 

-1.65 

0.64 

-1.81 

0.00 

0.55 

1.47 

30625 

-0.21 

59 

40 

0.32 

0.86 

-0.93 

0.71 

-0.94 

0.00 

0.54 

1.28 

30626 

-0.78 

46 

36 

0.38 

0.98 

-0.01 

0.96 

-0.02 

0.00 

0.35 

1.03 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30627 

-1.43 

57 

50 

0.43 

0.83 

-0.54 

1.66 

1.19 

0.00 

0.40 

1.08 

30628 

-1.59 

57 

51 

0.46 

0.87 

-0.30 

0.60 

-0.57 

0.00 

0.41 

1.12 

30629 

-1.14 

67 

57 

0.37 

0.87 

-0.56 

0.55 

-1.01 

0.00 

0.44 

1.18 

30630 

-0.78 

56 

44 

0.35 

0.98 

-0.02 

0.98 

0.06 

0.00 

0.39 

1.02 

30631 

-1.21 

57 

47 

0.39 

1.09 

0.46 

0.94 

0.01 

0.00 

0.40 

0.95 

30632 

0.75 

56 

24 

0.30 

0.96 

-0.31 

0.92 

-0.41 

0.00 

0.47 

1.13 

30633 

-0.53 

56 

41 

0.34 

0.93 

-0.36 

0.91 

-0.13 

0.00 

0.47 

1.10 

30634 

-0.03 

55 

37 

0.32 

0.94 

-0.39 

0.99 

0.05 

0.00 

0.44 

1.10 

30635 

-1.44 

55 

47 

0.41 

0.83 

-0.67 

0.52 

-1.02 

0.00 

0.46 

1.21 

30636 

-1.46 

52 

45 

0.43 

0.97 

-0.02 

1.42 

0.87 

0.00 

0.26 

0.98 

30637 

-0.31 

56 

42 

0.33 

0.97 

-0.15 

1.11 

0.45 

0.00 

0.35 

1.01 

30638 

-0.40 

57 

41 

0.32 

0.75 

-1.86 

0.61 

-1.40 

0.00 

0.55 

1.50 

30639 

-0.66 

69 

52 

0.31 

0.86 

-0.85 

0.65 

-1.15 

0.00 

0.53 

1.25 

30640 

0.13 

71 

44 

0.28 

0.95 

-0.43 

0.91 

-0.36 

0.00 

0.49 

1.12 

30641 

-1.75 

48 

42 

0.46 

0.99 

0.06 

1.12 

0.40 

0.00 

0.25 

0.97 

30642 

-1.87 

57 

51 

0.45 

1.09 

0.40 

1.31 

0.66 

0.00 

0.19 

0.89 

30643 

0.14 

69 

44 

0.28 

0.98 

-0.10 

0.89 

-0.57 

0.00 

0.45 

1.08 

30644 

0.03 

48 

30 

0.33 

0.97 

-0.17 

0.89 

-0.43 

0.00 

0.44 

1.11 

30645 

0.36 

58 

35 

0.29 

0.94 

-0.53 

0.86 

-0.62 

0.00 

0.46 

1.21 

30646 

-0.93 

55 

45 

0.38 

0.82 

-0.79 

0.62 

-1.06 

0.00 

0.53 

1.22 

30647 

0.84 

55 

28 

0.30 

0.99 

-0.06 

1.44 

2.03 

0.00 

0.41 

0.90 

30648 

2.66 

70 

11 

0.35 

1.22 

1.03 

1.49 

1.27 

0.00 

0.06 

0.73 

30649 

0.15 

56 

35 

0.31 

1.00 

0.07 

1.02 

0.16 

0.00 

0.43 

0.98 

30650 

-0.92 

56 

42 

0.34 

0.79 

-1.27 

0.64 

-1.12 

0.00 

0.56 

1.34 

30651 

-2.61 

59 

56 

0.61 

0.88 

-0.08 

0.40 

-0.61 

0.00 

0.33 

1.10 

30652 

0.31 

56 

33 

0.30 

1.22 

1.72 

1.22 

1.22 

0.00 

0.25 

0.46 

30653 

1.02 

58 

25 

0.29 

1.22 

1.85 

1.22 

1.19 

0.00 

0.25 

0.40 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30654 

-0.05 

295 

236 

0.16 

1.01 

0.14 

1.04 

0.25 

0.00 

0.37 

0.98 

30655 

-0.91 

56 

45 

0.36 

1.05 

0.33 

1.00 

0.13 

0.00 

0.28 

0.94 

30656 

-0.52 

54 

38 

0.34 

1.03 

0.23 

1.21 

0.80 

0.00 

0.44 

0.90 

30657 

-0.13 

48 

31 

0.33 

0.86 

-1.04 

0.75 

-1.15 

0.00 

0.55 

1.36 

30658 

0.32 

54 

34 

0.31 

1.03 

0.24 

1.12 

0.67 

0.00 

0.37 

0.90 

30659 

0.31 

56 

32 

0.30 

0.99 

-0.03 

0.94 

-0.29 

0.00 

0.43 

1.05 

30660 

-0.30 

56 

39 

0.32 

0.90 

-0.66 

0.98 

-0.02 

0.00 

0.45 

1.14 

30661 

-1.99 

53 

48 

0.50 

0.67 

-0.94 

0.30 

-1.07 

0.00 

0.56 

1.26 

30662 

-1.06 

56 

45 

0.37 

0.89 

-0.48 

0.63 

-1.00 

0.00 

0.51 

1.18 

30663 

-1.28 

54 

46 

0.42 

0.74 

-1.07 

0.43 

-1.20 

0.00 

0.54 

1.28 

30664 

-0.07 

53 

33 

0.32 

0.92 

-0.52 

0.86 

-0.56 

0.00 

0.53 

1.18 

30665 

2.11 

52 

11 

0.37 

1.05 

0.31 

1.23 

0.67 

0.00 

0.29 

0.88 

30666 

-2.30 

56 

50 

0.48 

0.95 

-0.06 

0.86 

0.06 

0.00 

0.38 

1.03 

30667 

-1.54 

54 

46 

0.42 

0.89 

-0.34 

0.76 

-0.39 

0.00 

0.43 

1.10 

30668 

-0.48 

53 

38 

0.33 

0.96 

-0.21 

0.82 

-0.55 

0.00 

0.45 

1.11 

30669 

-0.34 

3032 

2157 

0.04 

1.04 

1.76 

1.04 

1.15 

0.00 

0.37 

0.93 

30670 

-0.26 

58 

37 

0.31 

1.07 

0.53 

1.01 

0.10 

0.00 

0.41 

0.89 

30671 

0.58 

53 

26 

0.29 

0.83 

-1.87 

0.79 

-1.90 

0.00 

0.56 

1.75 

30672 

-0.20 

57 

37 

0.31 

1.12 

0.94 

1.23 

1.04 

0.00 

0.32 

0.70 

30673 

-1.03 

57 

47 

0.37 

0.82 

-0.81 

0.63 

-1.05 

0.00 

0.50 

1.22 

30674 

-2.72 

306 

299 

0.39 

0.92 

-0.11 

0.88 

-0.02 

0.00 

0.20 

1.04 

30675 

-1.26 

54 

45 

0.39 

0.87 

-0.53 

0.68 

-0.55 

0.00 

0.44 

1.16 

30676 

-1.06 

56 

44 

0.37 

0.84 

-0.73 

0.60 

-0.84 

0.00 

0.56 

1.22 

30677 

1.98 

55 

14 

0.33 

1.01 

0.11 

0.86 

-0.45 

0.00 

0.35 

1.04 

30678 

0.93 

56 

28 

0.30 

1.12 

1.00 

1.05 

0.32 

0.00 

0.37 

0.73 

30679 

1.54 

64 

22 

0.30 

0.94 

-0.41 

0.88 

-0.52 

0.00 

0.51 

1.13 

30680 

1.74 

56 

17 

0.33 

1.36 

2.19 

1.43 

1.31 

0.00 

0.21 

0.38 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30681 

3.13 

66 

10 

0.37 

0.92 

-0.30 

0.87 

-0.09 

0.00 

0.39 

1.07 

30682 

0.57 

57 

29 

0.29 

0.99 

-0.04 

0.92 

-0.48 

0.00 

0.45 

1.08 

30683 

0.27 

297 

232 

0.16 

0.83 

-2.14 

0.60 

-2.49 

0.00 

0.56 

1.25 

30684 

0.22 

63 

41 

0.29 

1.03 

0.25 

1.00 

0.05 

0.00 

0.39 

0.96 

30685 

0.63 

58 

32 

0.30 

0.77 

-2.05 

0.68 

-1.93 

0.00 

0.64 

1.61 

30686 

0.37 

58 

35 

0.30 

1.08 

0.68 

1.02 

0.17 

0.00 

0.38 

0.83 

30687 

3.60 

55 

4 

0.54 

1.06 

0.28 

1.26 

0.58 

0.00 

0.18 

0.93 

30688 

2.71 

59 

10 

0.38 

1.20 

0.93 

2.02 

2.17 

0.00 

0.09 

0.67 

30689 

2.56 

62 

13 

0.35 

0.96 

-0.15 

1.29 

0.81 

0.00 

0.41 

0.96 

30690 

3.09 

53 

7 

0.45 

0.98 

0.05 

0.95 

0.08 

0.00 

0.41 

1.00 

30691 

4.55 

56 

2 

0.74 

1.18 

0.47 

9.90 

3.38 

0.00 

-0.22 

0.65 

30692 

2.59 

56 

11 

0.37 

1.04 

0.24 

1.85 

1.85 

0.00 

0.27 

0.84 

30693 

3.16 

62 

8 

0.40 

0.95 

-0.09 

0.61 

-0.82 

0.00 

0.41 

1.10 

30694 

2.34 

58 

13 

0.34 

1.11 

0.64 

1.10 

0.44 

0.00 

0.23 

0.86 

30695 

2.96 

56 

7 

0.42 

1.20 

0.73 

1.47 

1.06 

0.00 

0.03 

0.81 

30696 

2.73 

54 

10 

0.39 

1.02 

0.17 

1.16 

0.55 

0.00 

0.38 

0.95 

30697 

1.89 

57 

18 

0.32 

0.83 

-1.21 

0.78 

-1.00 

0.00 

0.57 

1.33 

30698 

0.19 

54 

31 

0.31 

1.15 

1.28 

1.13 

0.76 

0.00 

0.31 

0.61 

30699 

-0.12 

62 

40 

0.29 

0.91 

-0.80 

0.81 

-0.82 

0.00 

0.49 

1.26 

30700 

0.12 

50 

33 

0.33 

0.78 

-1.61 

0.67 

-1.54 

0.00 

0.62 

1.49 

30701 

0.00 

48 

48 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

30702 

-1.59 

58 

52 

0.45 

1.01 

0.15 

1.01 

0.22 

0.00 

0.21 

0.98 

30703 

0.00 

47 

47 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

30704 

-0.36 

40 

30 

0.40 

1.21 

1.14 

1.44 

1.11 

0.00 

0.16 

0.57 

30705 

-3.03 

39 

38 

1.02 

0.95 

0.26 

0.39 

-0.17 

0.00 

0.25 

1.06 

30706 

-3.38 

43 

42 

1.02 

0.87 

0.16 

0.20 

-0.40 

0.00 

0.34 

1.11 

30707 

-1.35 

31 

26 

0.51 

1.14 

0.52 

1.36 

0.72 

0.00 

0.12 

0.83 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30708 

-2.54 

40 

38 

0.74 

1.01 

0.22 

0.93 

0.28 

0.00 

0.15 

0.99 

30709 

-1.70 

47 

41 

0.47 

1.16 

0.59 

1.61 

1.18 

0.00 

0.09 

0.79 

30710 

-1.56 

48 

42 

0.45 

1.21 

0.73 

1.70 

1.13 

0.00 

-0.01 

0.75 

30711 

-1.79 

50 

46 

0.53 

1.05 

0.26 

0.97 

0.20 

0.00 

0.12 

0.97 

30712 

-0.97 

54 

43 

0.39 

0.94 

-0.18 

1.24 

0.65 

0.00 

0.47 

0.98 

30713 

-1.01 

52 

43 

0.39 

1.12 

0.58 

1.29 

0.78 

0.00 

0.21 

0.84 

30714 

-2.24 

44 

41 

0.62 

0.87 

-0.13 

0.51 

-0.42 

0.00 

0.32 

1.11 

30715 

-3.63 

60 

59 

1.02 

1.02 

0.34 

0.74 

0.22 

0.00 

0.09 

0.99 

30716 

-2.24 

37 

34 

0.62 

0.96 

0.06 

0.57 

-0.34 

0.00 

0.32 

1.07 

30717 

-2.56 

37 

35 

0.74 

1.06 

0.29 

0.78 

0.11 

0.00 

0.16 

0.98 

30718 

-3.48 

53 

52 

1.01 

0.99 

0.31 

0.55 

0.03 

0.00 

0.13 

1.02 

30719 

-0.79 

54 

42 

0.35 

0.95 

-0.21 

0.99 

0.07 

0.00 

0.40 

1.04 

30720 

-1.03 

54 

43 

0.36 

1.02 

0.18 

1.10 

0.38 

0.00 

0.29 

0.95 

30721 

-0.76 

49 

37 

0.36 

1.08 

0.45 

1.07 

0.33 

0.00 

0.34 

0.89 

30722 

-2.19 

57 

53 

0.54 

0.77 

-0.49 

0.34 

-0.73 

0.00 

0.45 

1.18 

30723 

-2.35 

56 

52 

0.54 

1.09 

0.36 

1.15 

0.45 

0.00 

0.16 

0.93 

30724 

-2.42 

38 

36 

0.75 

0.88 

0.00 

0.35 

-0.43 

0.00 

0.34 

1.11 

30725 

-1.54 

43 

38 

0.50 

0.96 

-0.02 

0.91 

0.09 

0.00 

0.27 

1.03 

30726 

0.04 

57 

38 

0.31 

1.05 

0.40 

1.14 

0.70 

0.00 

0.36 

0.86 

30727 

-1.60 

57 

51 

0.46 

0.99 

0.07 

0.78 

-0.12 

0.00 

0.33 

1.02 

30728 

-1.07 

53 

43 

0.38 

0.84 

-0.72 

0.59 

-0.88 

0.00 

0.51 

1.22 

30729 

-1.55 

57 

50 

0.43 

1.15 

0.59 

0.81 

-0.19 

0.00 

0.23 

0.94 

30730 

-2.81 

53 

50 

0.61 

0.97 

0.10 

0.67 

-0.09 

0.00 

0.24 

1.03 

30731 

-0.21 

57 

39 

0.32 

1.05 

0.41 

1.07 

0.33 

0.00 

0.38 

0.88 

30732 

-2.33 

51 

47 

0.59 

0.88 

-0.13 

0.43 

-0.58 

0.00 

0.51 

1.11 

30733 

-0.06 

49 

32 

0.33 

0.91 

-0.64 

0.78 

-0.68 

0.00 

0.49 

1.25 

30734 

-1.95 

54 

48 

0.46 

1.01 

0.12 

0.85 

0.01 

0.00 

0.29 

1.00 

easyCBM  CCSS  Third  Grade  Math  Measure  Development 


191 

Appendix  D:  Item  Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30735 

0.02 

39 

26 

0.37 

1.42 

2.34 

1.52 

2.15 

0.00 

-0.05 

0.10 

30736 

1.03 

38 

20 

0.37 

1.04 

0.32 

0.97 

-0.07 

0.00 

0.40 

0.93 

30737 

1.52 

41 

17 

0.35 

1.14 

0.93 

1.20 

1.00 

0.00 

0.33 

0.66 

30738 

0.06 

47 

32 

0.33 

1.07 

0.53 

1.11 

0.61 

0.00 

0.24 

0.82 

30739 

-2.67 

50 

47 

0.69 

0.69 

-0.40 

0.22 

-0.97 

0.00 

0.65 

1.19 

30740 

0.00 

33 

33 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

30741 

-1.01 

56 

44 

0.35 

1.14 

0.75 

1.18 

0.66 

0.00 

0.22 

0.83 

30742 

-1.42 

40 

35 

0.51 

1.19 

0.63 

1.36 

0.76 

0.00 

0.14 

0.84 

30743 

-0.20 

50 

34 

0.33 

1.23 

1.63 

1.26 

1.21 

0.00 

0.13 

0.49 

30744 

-1.69 

47 

42 

0.49 

1.05 

0.26 

1.00 

0.17 

0.00 

0.19 

0.97 

30745 

-1.39 

53 

45 

0.40 

0.98 

-0.01 

0.82 

-0.31 

0.00 

0.32 

1.04 

30746 

-2.61 

49 

47 

0.74 

0.97 

0.17 

0.58 

-0.17 

0.00 

0.26 

1.04 

30747 

0.15 

52 

33 

0.32 

0.96 

-0.25 

0.90 

-0.32 

0.00 

0.45 

1.10 

30748 

-0.79 

51 

41 

0.37 

1.15 

0.77 

1.32 

1.03 

0.00 

0.08 

0.79 

30749 

-1.11 

47 

38 

0.39 

1.08 

0.44 

0.92 

-0.08 

0.00 

0.25 

0.94 

30750 

-1.86 

58 

51 

0.43 

0.97 

-0.02 

0.65 

-0.49 

0.00 

0.38 

1.07 

30751 

1.09 

286 

173 

0.14 

0.89 

-1.89 

0.84 

-1.54 

0.00 

0.53 

1.25 

30752 

-2.55 

57 

54 

0.61 

1.08 

0.33 

2.36 

1.51 

0.00 

0.01 

0.89 

30753 

-1.49 

57 

49 

0.40 

1.03 

0.22 

0.98 

0.10 

0.00 

0.29 

0.98 

30754 

-1.15 

44 

38 

0.46 

0.81 

-0.56 

0.54 

-0.91 

0.00 

0.51 

1.20 

30755 

1.20 

58 

25 

0.29 

1.16 

1.46 

1.24 

1.49 

0.00 

0.24 

0.46 

30756 

-2.79 

42 

39 

0.69 

0.94 

0.07 

0.64 

-0.04 

0.00 

0.44 

1.04 

30757 

-0.25 

40 

28 

0.38 

0.82 

-1.05 

0.71 

-1.07 

0.00 

0.59 

1.34 

30758 

-0.63 

42 

32 

0.40 

1.02 

0.19 

1.00 

0.12 

0.00 

0.40 

0.97 

30759 

1.48 

60 

21 

0.30 

0.92 

-0.57 

0.92 

-0.28 

0.00 

0.47 

1.15 

30760 

-2.62 

53 

49 

0.56 

0.68 

-0.79 

0.24 

-0.85 

0.00 

0.49 

1.25 

30761 

-2.82 

52 

50 

0.74 

0.93 

0.10 

0.39 

-0.39 

0.00 

0.25 

1.08 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30762 

-1.36 

62 

53 

0.39 

0.83 

-0.71 

0.57 

-0.97 

0.00 

0.46 

1.20 

30763 

-0.87 

59 

46 

0.34 

1.27 

1.38 

1.54 

1.38 

0.00 

0.15 

0.60 

30764 

-1.28 

54 

44 

0.39 

1.11 

0.51 

1.06 

0.28 

0.00 

0.30 

0.90 

30765 

-0.95 

299 

267 

0.20 

1.10 

0.74 

1.12 

0.47 

0.00 

0.25 

0.92 

30766 

-0.41 

55 

41 

0.33 

0.94 

-0.32 

1.02 

0.17 

0.00 

0.35 

1.05 

30767 

-1.88 

52 

46 

0.47 

0.83 

-0.48 

0.58 

-0.38 

0.00 

0.43 

1.14 

30768 

1.39 

62 

22 

0.30 

0.98 

-0.10 

1.29 

1.39 

0.00 

0.41 

0.95 

30769 

1.07 

54 

23 

0.30 

0.88 

-1.13 

0.88 

-0.63 

0.00 

0.50 

1.35 

30770 

0.92 

55 

25 

0.30 

1.21 

1.86 

1.25 

1.43 

0.00 

0.21 

0.32 

30771 

2.68 

3051 

530 

0.05 

1.18 

5.33 

1.53 

7.72 

0.00 

0.20 

0.77 

30772 

1.34 

51 

19 

0.32 

0.95 

-0.33 

0.88 

-0.59 

0.00 

0.46 

1.15 

30773 

1.16 

65 

29 

0.28 

1.03 

0.31 

0.96 

-0.18 

0.00 

0.44 

0.96 

30774 

2.01 

58 

14 

0.33 

0.96 

-0.17 

1.04 

0.22 

0.00 

0.32 

1.02 

30775 

2.13 

56 

14 

0.34 

1.23 

1.30 

1.45 

1.51 

0.00 

0.17 

0.63 

30776 

2.09 

54 

14 

0.34 

1.16 

0.95 

1.62 

1.78 

0.00 

0.23 

0.64 

30777 

2.38 

54 

12 

0.37 

1.13 

0.67 

1.24 

0.66 

0.00 

0.35 

0.82 

30778 

1.20 

64 

27 

0.27 

1.01 

0.10 

1.02 

0.18 

0.00 

0.38 

0.97 

30779 

2.57 

57 

10 

0.39 

1.07 

0.35 

3.58 

3.52 

0.00 

0.19 

0.70 

30780 

4.21 

56 

4 

0.61 

1.09 

0.34 

1.19 

0.49 

0.00 

0.35 

0.93 

30781 

1.63 

56 

19 

0.31 

1.18 

1.31 

1.11 

0.40 

0.00 

0.31 

0.65 

30782 

2.94 

57 

10 

0.41 

1.30 

1.21 

2.24 

2.00 

0.00 

0.25 

0.59 

30783 

1.36 

47 

16 

0.35 

1.07 

0.48 

1.31 

0.79 

0.00 

0.37 

0.79 

30784 

0.72 

54 

27 

0.30 

0.84 

-1.60 

0.79 

-1.22 

0.00 

0.54 

1.56 

30785 

0.72 

56 

30 

0.29 

0.87 

-1.40 

0.78 

-0.78 

0.00 

0.50 

1.52 

30786 

-0.34 

54 

40 

0.34 

0.93 

-0.36 

0.75 

-0.72 

0.00 

0.45 

1.17 

30787 

2.05 

55 

15 

0.34 

0.95 

-0.25 

1.03 

0.21 

0.00 

0.44 

1.03 

30788 

0.24 

57 

34 

0.31 

1.19 

1.46 

1.12 

0.55 

0.00 

0.34 

0.60 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30789 

0.40 

61 

37 

0.29 

0.95 

-0.43 

0.85 

-0.65 

0.00 

0.49 

1.17 

30790 

1.78 

70 

17 

0.30 

1.02 

0.16 

1.10 

0.44 

0.00 

0.33 

0.97 

30791 

1.99 

56 

16 

0.33 

1.01 

0.11 

1.16 

0.64 

0.00 

0.41 

0.92 

30792 

2.03 

70 

20 

0.29 

0.87 

-0.88 

0.79 

-0.80 

0.00 

0.50 

1.22 

30793 

1.28 

56 

22 

0.31 

0.86 

-1.11 

0.78 

-1.09 

0.00 

0.56 

1.34 

30794 

2.40 

59 

11 

0.36 

1.02 

0.16 

1.06 

0.28 

0.00 

0.31 

0.96 

30795 

-0.49 

66 

46 

0.29 

0.88 

-0.94 

0.79 

-0.98 

0.00 

0.47 

1.27 

30796 

0.82 

173 

101 

0.17 

1.15 

2.07 

1.38 

2.65 

0.00 

0.32 

0.55 

30797 

0.82 

53 

27 

0.30 

1.04 

0.36 

1.02 

0.20 

0.00 

0.40 

0.89 

30798 

1.06 

55 

24 

0.31 

0.95 

-0.38 

0.90 

-0.43 

0.00 

0.52 

1.14 

30799 

-0.74 

57 

43 

0.34 

0.87 

-0.67 

0.91 

-0.18 

0.00 

0.51 

1.14 

30800 

0.67 

56 

29 

0.29 

0.85 

-1.55 

0.79 

-1.48 

0.00 

0.54 

1.58 

30801 

-1.04 

61 

49 

0.35 

0.97 

-0.11 

0.98 

0.12 

0.00 

0.41 

1.04 

30802 

0.43 

58 

36 

0.30 

0.94 

-0.49 

0.89 

-0.61 

0.00 

0.46 

1.18 

30803 

0.29 

54 

36 

0.31 

0.83 

-1.37 

0.74 

-1.36 

0.00 

0.55 

1.42 

30804 

0.42 

56 

32 

0.30 

0.77 

-2.13 

0.69 

-1.99 

0.00 

0.64 

1.65 

30805 

-0.51 

56 

42 

0.34 

0.75 

-1.61 

0.72 

-0.94 

0.00 

0.61 

1.36 

30806 

0.26 

57 

36 

0.30 

0.91 

-0.76 

0.85 

-0.82 

0.00 

0.49 

1.25 

30807 

-0.16 

60 

43 

0.31 

1.04 

0.31 

0.98 

-0.03 

0.00 

0.38 

0.95 

30808 

-0.38 

48 

34 

0.35 

0.83 

-1.09 

0.64 

-1.24 

0.00 

0.57 

1.37 

30809 

-0.31 

57 

38 

0.31 

0.96 

-0.23 

0.96 

-0.08 

0.00 

0.44 

1.06 

30810 

-0.02 

56 

38 

0.32 

0.82 

-1.28 

0.86 

-0.41 

0.00 

0.55 

1.31 

30811 

-3.50 

57 

56 

1.02 

1.03 

0.35 

0.79 

0.31 

0.00 

0.09 

0.98 

30812 

-1.74 

57 

50 

0.45 

0.94 

-0.07 

0.91 

0.02 

0.00 

0.44 

1.03 

30813 

-3.07 

285 

280 

0.48 

0.87 

-0.16 

0.58 

-0.54 

0.00 

0.24 

1.04 

30814 

-1.49 

56 

48 

0.42 

1.27 

1.07 

1.92 

1.49 

0.00 

0.15 

0.68 

30815 

-2.92 

56 

54 

0.73 

0.95 

0.14 

0.55 

-0.22 

0.00 

0.20 

1.05 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30816 

-1.79 

56 

50 

0.45 

0.90 

-0.21 

0.73 

-0.34 

0.00 

0.34 

1.08 

30817 

-4.25 

55 

53 

1.17 

0.34 

-0.69 

0.03 

-1.01 

0.00 

0.77 

1.23 

30818 

-2.73 

58 

55 

0.62 

1.04 

0.25 

0.52 

-0.37 

0.00 

0.27 

1.03 

30819 

-3.55 

57 

56 

1.02 

1.05 

0.36 

1.10 

0.52 

0.00 

0.06 

0.95 

30820 

-3.53 

56 

55 

1.02 

1.05 

0.37 

1.41 

0.72 

0.00 

0.01 

0.94 

30821 

1.22 

277 

157 

0.14 

1.02 

0.33 

0.98 

-0.23 

0.00 

0.48 

0.98 

30822 

2.54 

50 

10 

0.39 

1.29 

1.22 

1.67 

1.47 

0.00 

0.17 

0.61 

30823 

0.94 

59 

27 

0.29 

1.26 

2.14 

1.32 

1.74 

0.00 

0.22 

0.28 

30824 

2.22 

57 

11 

0.35 

1.23 

1.15 

1.68 

1.81 

0.00 

0.01 

0.64 

30825 

0.17 

56 

37 

0.30 

1.06 

0.56 

1.03 

0.21 

0.00 

0.27 

0.84 

30826 

2.49 

61 

10 

0.36 

0.95 

-0.16 

0.81 

-0.47 

0.00 

0.37 

1.07 

30827 

3.35 

57 

6 

0.45 

1.18 

0.63 

1.42 

0.90 

0.00 

0.01 

0.84 

30828 

2.09 

57 

14 

0.34 

1.17 

1.00 

1.26 

0.95 

0.00 

0.22 

0.74 

30829 

2.08 

57 

15 

0.32 

0.99 

-0.03 

0.99 

0.06 

0.00 

0.37 

1.02 

30830 

0.80 

56 

30 

0.29 

0.95 

-0.55 

0.97 

-0.18 

0.00 

0.42 

1.18 

30831 

-1.61 

58 

51 

0.42 

0.99 

0.05 

0.94 

0.03 

0.00 

0.28 

1.00 

30832 

-0.17 

57 

41 

0.32 

0.80 

-1.41 

0.64 

-1.33 

0.00 

0.57 

1.39 

30833 

-0.98 

61 

50 

0.35 

1.05 

0.29 

1.10 

0.38 

0.00 

0.25 

0.94 

30834 

-1.30 

53 

46 

0.43 

0.88 

-0.35 

0.78 

-0.32 

0.00 

0.43 

1.10 

30835 

-1.18 

59 

51 

0.40 

0.71 

-1.15 

0.49 

-1.31 

0.00 

0.59 

1.26 

30836 

-1.39 

60 

50 

0.37 

0.97 

-0.05 

1.11 

0.44 

0.00 

0.30 

0.99 

30837 

-0.78 

61 

47 

0.33 

0.94 

-0.29 

1.05 

0.25 

0.00 

0.39 

1.03 

30838 

-0.33 

57 

40 

0.32 

0.96 

-0.20 

0.94 

-0.22 

0.00 

0.43 

1.07 

30839 

3.28 

60 

6 

0.45 

0.96 

-0.03 

0.79 

-0.23 

0.00 

0.31 

1.04 

30840 

-1.06 

58 

48 

0.37 

0.96 

-0.12 

0.90 

-0.15 

0.00 

0.39 

1.05 

30841 

-0.21 

57 

39 

0.31 

0.90 

-0.77 

0.84 

-0.82 

0.00 

0.48 

1.24 

30842 

-0.81 

48 

39 

0.40 

0.91 

-0.30 

0.77 

-0.42 

0.00 

0.39 

1.12 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30843 

1.20 

56 

26 

0.30 

0.91 

-0.73 

0.85 

-0.89 

0.00 

0.52 

1.27 

30844 

-0.24 

60 

42 

0.31 

1.09 

0.65 

1.11 

0.53 

0.00 

0.32 

0.84 

30845 

1.09 

59 

28 

0.29 

1.00 

0.08 

0.99 

0.00 

0.00 

0.40 

0.99 

30846 

1.41 

59 

21 

0.31 

0.81 

-1.44 

0.77 

-1.19 

0.00 

0.59 

1.38 

30847 

0.51 

60 

33 

0.29 

0.77 

-2.11 

0.71 

-1.99 

0.00 

0.65 

1.60 

30848 

1.41 

57 

21 

0.30 

1.00 

0.00 

0.96 

-0.23 

0.00 

0.41 

1.04 

30849 

0.15 

56 

36 

0.30 

0.93 

-0.59 

0.88 

-0.57 

0.00 

0.43 

1.21 

30850 

-0.05 

57 

40 

0.31 

1.05 

0.36 

1.14 

0.68 

0.00 

0.31 

0.87 

30851 

-1.01 

34 

28 

0.48 

0.82 

-0.62 

0.53 

-0.68 

0.00 

0.48 

1.26 

30852 

-1.50 

40 

34 

0.47 

0.94 

-0.14 

0.81 

-0.19 

0.00 

0.37 

1.07 

30853 

1.39 

44 

14 

0.34 

1.13 

0.93 

1.14 

0.73 

0.00 

0.19 

0.70 

30854 

-1.23 

59 

49 

0.37 

0.97 

-0.08 

0.87 

-0.24 

0.00 

0.35 

1.05 

30855 

0.43 

50 

28 

0.32 

0.84 

-1.40 

0.76 

-1.11 

0.00 

0.55 

1.49 

30856 

0.03 

47 

33 

0.34 

1.13 

0.90 

1.27 

1.14 

0.00 

0.18 

0.67 

30857 

1.82 

61 

25 

0.30 

1.14 

1.21 

1.57 

2.44 

0.00 

0.33 

0.52 

30858 

1.55 

48 

17 

0.34 

1.13 

0.92 

1.33 

1.27 

0.00 

0.33 

0.64 

30859 

2.09 

59 

14 

0.33 

1.12 

0.78 

1.43 

1.44 

0.00 

0.18 

0.73 

30860 

0.36 

60 

35 

0.28 

1.33 

2.83 

1.40 

2.47 

0.00 

0.04 

-0.04 

30861 

1.54 

57 

20 

0.30 

1.24 

1.84 

1.41 

1.87 

0.00 

0.18 

0.35 

30862 

0.49 

60 

36 

0.29 

1.22 

1.82 

1.26 

1.50 

0.00 

0.23 

0.42 

30863 

2.49 

56 

13 

0.35 

1.06 

0.35 

1.13 

0.51 

0.00 

0.39 

0.91 

30864 

-2.13 

39 

35 

0.56 

1.05 

0.25 

0.85 

0.12 

0.00 

0.26 

0.97 

30865 

-2.46 

43 

40 

0.62 

0.77 

-0.35 

0.38 

-0.83 

0.00 

0.48 

1.17 

30866 

-1.13 

61 

52 

0.38 

1.01 

0.12 

0.96 

0.04 

0.00 

0.31 

1.00 

30867 

1.70 

61 

19 

0.30 

1.12 

0.95 

1.13 

0.69 

0.00 

0.25 

0.75 

30868 

-2.10 

55 

49 

0.46 

0.96 

-0.02 

0.72 

-0.25 

0.00 

0.33 

1.05 

30869 

-2.36 

52 

49 

0.63 

0.73 

-0.43 

0.38 

-0.68 

0.00 

0.43 

1.16 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30870 

-2.71 

57 

53 

0.58 

0.71 

-0.54 

0.35 

-0.95 

0.00 

0.59 

1.17 

30871 

-1.27 

41 

36 

0.49 

1.12 

0.46 

1.25 

0.59 

0.00 

0.08 

0.87 

30872 

-1.17 

53 

44 

0.41 

1.20 

0.82 

1.12 

0.40 

0.00 

0.27 

0.84 

30873 

-3.76 

59 

58 

1.01 

1.02 

0.33 

0.83 

0.31 

0.00 

0.08 

0.99 

30874 

-2.09 

45 

41 

0.55 

0.99 

0.10 

0.88 

0.04 

0.00 

0.27 

1.01 

30875 

-2.08 

266 

253 

0.30 

0.91 

-0.31 

0.46 

-1.32 

0.00 

0.32 

1.08 

30876 

0.46 

58 

37 

0.30 

1.21 

1.53 

1.22 

1.04 

0.00 

0.24 

0.54 

30877 

-2.51 

59 

55 

0.55 

0.93 

-0.02 

0.84 

0.06 

0.00 

0.32 

1.03 

30878 

-1.95 

49 

44 

0.53 

1.05 

0.26 

1.21 

0.51 

0.00 

0.36 

0.95 

30879 

0.53 

58 

34 

0.29 

1.11 

1.07 

1.07 

0.50 

0.00 

0.29 

0.68 

30880 

1.95 

58 

15 

0.33 

0.96 

-0.17 

1.10 

0.43 

0.00 

0.44 

1.03 

30881 

0.55 

59 

27 

0.28 

1.20 

1.99 

1.35 

1.40 

0.00 

0.19 

0.16 

30882 

0.77 

283 

191 

0.15 

1.13 

1.89 

1.17 

1.31 

0.00 

0.40 

0.77 

30883 

0.75 

60 

32 

0.29 

0.83 

-1.71 

0.79 

-1.30 

0.00 

0.57 

1.51 

30884 

-1.94 

43 

39 

0.56 

0.90 

-0.14 

0.44 

-0.65 

0.00 

0.44 

1.13 

30885 

0.49 

46 

24 

0.33 

1.29 

2.35 

1.46 

1.55 

0.00 

0.17 

-0.05 

30886 

3.30 

54 

7 

0.47 

1.34 

1.06 

2.68 

2.07 

0.00 

0.18 

0.64 

30887 

1.72 

39 

14 

0.37 

1.53 

2.98 

1.64 

2.20 

0.00 

0.02 

-0.15 

30888 

-2.55 

64 

60 

0.54 

1.10 

0.36 

1.02 

0.30 

0.00 

0.18 

0.95 

30889 

-2.16 

46 

43 

0.61 

1.02 

0.21 

1.01 

0.30 

0.00 

0.17 

0.97 

30890 

-0.78 

39 

31 

0.42 

0.90 

-0.37 

1.15 

0.53 

0.00 

0.38 

1.06 

30891 

1.93 

56 

15 

0.32 

1.05 

0.35 

1.57 

2.15 

0.00 

0.22 

0.77 

30892 

2.03 

65 

17 

0.32 

0.81 

-1.23 

0.72 

-0.94 

0.00 

0.59 

1.28 

30893 

1.49 

59 

22 

0.29 

1.13 

1.10 

1.18 

1.05 

0.00 

0.27 

0.66 

30894 

1.05 

63 

33 

0.28 

0.94 

-0.55 

0.86 

-0.84 

0.00 

0.47 

1.24 

30895 

2.34 

57 

14 

0.34 

0.81 

-1.08 

0.92 

-0.22 

0.00 

0.53 

1.22 

30896 

2.25 

56 

13 

0.35 

0.89 

-0.57 

0.71 

-0.66 

0.00 

0.48 

1.19 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30897 

-0.04 

59 

39 

0.31 

0.85 

-1.17 

0.77 

-0.87 

0.00 

0.54 

1.33 

30898 

0.58 

55 

30 

0.30 

1.08 

0.76 

1.05 

0.42 

0.00 

0.34 

0.77 

30899 

0.74 

56 

29 

0.30 

1.04 

0.46 

1.00 

0.08 

0.00 

0.38 

0.87 

30900 

1.53 

302 

158 

0.13 

1.00 

-0.07 

1.00 

0.00 

0.00 

0.48 

1.01 

30901 

0.65 

58 

28 

0.30 

0.97 

-0.21 

0.92 

-0.36 

0.00 

0.49 

1.09 

30902 

0.28 

57 

36 

0.30 

0.93 

-0.58 

0.87 

-0.58 

0.00 

0.46 

1.21 

30903 

1.73 

57 

18 

0.32 

0.98 

-0.06 

0.86 

-0.16 

0.00 

0.42 

1.07 

30904 

1.81 

56 

18 

0.33 

0.96 

-0.18 

0.94 

-0.21 

0.00 

0.50 

1.07 

30905 

2.21 

56 

13 

0.35 

0.98 

-0.04 

1.10 

0.41 

0.00 

0.40 

0.98 

30906 

1.65 

56 

20 

0.31 

0.83 

-1.36 

0.72 

-1.33 

0.00 

0.50 

1.43 

30907 

-1.51 

40 

36 

0.55 

0.94 

-0.02 

0.71 

-0.30 

0.00 

0.35 

1.06 

30908 

1.09 

46 

19 

0.33 

0.90 

-0.77 

0.93 

-0.35 

0.00 

0.51 

1.24 

30909 

0.17 

55 

35 

0.31 

1.05 

0.42 

0.96 

-0.10 

0.00 

0.39 

0.93 

30910 

0.03 

59 

35 

0.29 

0.84 

-1.58 

0.77 

-1.45 

0.00 

0.55 

1.52 

30911 

-0.89 

54 

44 

0.37 

1.12 

0.63 

1.06 

0.27 

0.00 

0.18 

0.87 

30912 

-0.73 

42 

33 

0.41 

0.98 

-0.03 

0.87 

-0.11 

0.00 

0.39 

1.05 

30913 

0.48 

57 

32 

0.29 

0.96 

-0.34 

0.90 

-0.59 

0.00 

0.44 

1.16 

30914 

-0.77 

294 

259 

0.19 

0.93 

-0.53 

0.69 

-1.03 

0.00 

0.37 

1.08 

30915 

-0.01 

58 

40 

0.31 

1.23 

1.63 

1.44 

1.70 

0.00 

0.15 

0.47 

30916 

2.50 

55 

11 

0.37 

0.91 

-0.41 

1.00 

0.12 

0.00 

0.44 

1.07 

30917 

-0.43 

59 

42 

0.33 

1.04 

0.30 

1.52 

1.48 

0.00 

0.40 

0.87 

30918 

-0.64 

53 

39 

0.36 

1.12 

0.70 

1.00 

0.12 

0.00 

0.42 

0.87 

30919 

1.43 

52 

19 

0.32 

0.86 

-1.13 

0.78 

-0.94 

0.00 

0.54 

1.36 

30920 

1.65 

52 

16 

0.32 

1.14 

1.03 

1.68 

2.04 

0.00 

0.16 

0.52 

30921 

-0.23 

57 

40 

0.32 

0.89 

-0.75 

0.74 

-0.94 

0.00 

0.51 

1.25 

30922 

-0.69 

62 

46 

0.31 

1.01 

0.12 

0.95 

-0.12 

0.00 

0.35 

1.00 

30923 

0.93 

58 

27 

0.30 

1.22 

1.74 

1.31 

1.83 

0.00 

0.26 

0.41 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30924 

-2.24 

57 

53 

0.58 

0.97 

0.10 

0.90 

0.15 

0.00 

0.36 

1.01 

30925 

0.86 

59 

29 

0.30 

1.03 

0.33 

1.04 

0.28 

0.00 

0.44 

0.90 

30926 

1.38 

57 

22 

0.30 

1.12 

1.00 

1.50 

2.47 

0.00 

0.29 

0.55 

30927 

1.73 

55 

18 

0.33 

0.74 

-1.75 

0.61 

-1.54 

0.00 

0.66 

1.46 

30928 

0.27 

58 

36 

0.29 

1.19 

1.72 

1.11 

0.57 

0.00 

0.22 

0.49 

30929 

0.75 

303 

199 

0.14 

0.87 

-2.35 

0.79 

-1.77 

0.00 

0.54 

1.28 

30930 

0.96 

61 

28 

0.29 

0.99 

-0.04 

1.04 

0.29 

0.00 

0.44 

0.99 

30931 

1.34 

59 

21 

0.31 

0.92 

-0.55 

0.97 

-0.08 

0.00 

0.50 

1.12 

30932 

-1.41 

56 

48 

0.41 

1.22 

0.87 

1.17 

0.49 

0.00 

0.20 

0.82 

30933 

-0.04 

57 

37 

0.30 

0.82 

-1.48 

0.73 

-1.49 

0.00 

0.57 

1.45 

30934 

-0.85 

56 

47 

0.38 

0.84 

-0.65 

0.68 

-0.64 

0.00 

0.43 

1.18 

30935 

-0.07 

53 

34 

0.32 

0.93 

-0.46 

0.85 

-0.64 

0.00 

0.51 

1.17 

30936 

-0.90 

53 

41 

0.36 

0.70 

-1.63 

0.54 

-1.56 

0.00 

0.66 

1.39 

30937 

0.60 

59 

31 

0.29 

0.90 

-0.87 

0.91 

-0.50 

0.00 

0.51 

1.26 

30938 

0.67 

56 

28 

0.31 

0.82 

-1.58 

0.72 

-0.84 

0.00 

0.57 

1.50 

30939 

0.68 

58 

31 

0.30 

0.92 

-0.63 

0.87 

-0.45 

0.00 

0.51 

1.21 

30940 

1.11 

55 

24 

0.30 

0.78 

-1.79 

0.70 

-2.03 

0.00 

0.65 

1.56 

30941 

0.59 

59 

32 

0.29 

0.76 

-2.40 

0.69 

-2.16 

0.00 

0.64 

1.74 

30942 

0.72 

55 

30 

0.30 

0.98 

-0.16 

0.94 

-0.30 

0.00 

0.46 

1.08 

30943 

0.34 

56 

35 

0.31 

0.98 

-0.10 

0.89 

-0.35 

0.00 

0.44 

1.08 

30944 

0.90 

57 

30 

0.30 

1.00 

0.08 

0.96 

-0.17 

0.00 

0.44 

1.01 

30945 

-0.28 

48 

34 

0.35 

0.94 

-0.30 

0.85 

-0.40 

0.00 

0.45 

1.12 

30946 

0.76 

62 

27 

0.28 

1.22 

1.86 

1.24 

1.46 

0.00 

0.24 

0.41 

30947 

0.46 

62 

37 

0.30 

0.96 

-0.27 

0.91 

-0.36 

0.00 

0.50 

1.10 

30948 

1.49 

53 

16 

0.33 

1.29 

1.70 

1.33 

1.16 

0.00 

0.23 

0.49 

30949 

-2.03 

57 

51 

0.49 

0.89 

-0.19 

0.64 

-0.44 

0.00 

0.50 

1.09 

30950 

-1.69 

61 

55 

0.45 

0.82 

-0.46 

0.56 

-0.62 

0.00 

0.41 

1.14 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30951 

-0.14 

54 

37 

0.35 

0.78 

-1.33 

0.59 

-1.36 

0.00 

0.66 

1.37 

30952 

0.23 

57 

34 

0.31 

1.04 

0.31 

1.30 

1.15 

0.00 

0.45 

0.86 

30953 

0.65 

60 

28 

0.28 

0.96 

-0.31 

0.95 

-0.29 

0.00 

0.44 

1.11 

30954 

0.76 

58 

28 

0.29 

0.91 

-0.86 

0.89 

-0.77 

0.00 

0.49 

1.30 

30955 

1.74 

57 

17 

0.31 

1.05 

0.40 

1.04 

0.26 

0.00 

0.29 

0.89 

30956 

0.33 

56 

36 

0.32 

0.95 

-0.35 

0.85 

-0.69 

0.00 

0.48 

1.16 

30957 

1.12 

55 

23 

0.31 

1.07 

0.58 

1.11 

0.60 

0.00 

0.39 

0.82 

30958 

1.58 

53 

19 

0.32 

0.98 

-0.10 

1.71 

2.73 

0.00 

0.37 

0.88 

30959 

0.89 

58 

28 

0.29 

0.98 

-0.15 

0.90 

-0.54 

0.00 

0.45 

1.12 

30960 

0.37 

59 

34 

0.28 

0.95 

-0.48 

0.93 

-0.46 

0.00 

0.42 

1.18 

30961 

1.13 

50 

22 

0.32 

1.12 

0.89 

1.07 

0.42 

0.00 

0.39 

0.76 

30962 

1.99 

60 

16 

0.32 

1.12 

0.78 

1.45 

1.64 

0.00 

0.23 

0.71 

30963 

1.92 

53 

16 

0.33 

1.00 

0.07 

0.87 

-0.37 

0.00 

0.44 

1.04 

30964 

-1.14 

59 

51 

0.40 

1.07 

0.35 

1.23 

0.61 

0.00 

0.19 

0.91 

30965 

0.33 

60 

35 

0.28 

0.98 

-0.22 

0.93 

-0.36 

0.00 

0.40 

1.11 

30966 

3.08 

54 

8 

0.44 

1.01 

0.15 

2.49 

2.31 

0.00 

0.30 

0.80 

30967 

0.64 

60 

33 

0.29 

0.88 

-1.16 

0.80 

-0.87 

0.00 

0.52 

1.40 

30968 

0.50 

57 

34 

0.30 

0.89 

-0.90 

0.78 

-0.92 

0.00 

0.52 

1.32 

30969 

0.26 

48 

27 

0.33 

0.77 

-1.91 

0.68 

-1.68 

0.00 

0.64 

1.61 

30970 

1.72 

59 

18 

0.31 

1.20 

1.29 

1.19 

0.90 

0.00 

0.25 

0.67 

30971 

0.54 

57 

31 

0.29 

1.06 

0.57 

1.20 

1.25 

0.00 

0.34 

0.75 

30972 

-0.22 

56 

36 

0.30 

1.07 

0.68 

1.00 

0.09 

0.00 

0.31 

0.83 

30973 

-0.37 

58 

42 

0.31 

1.02 

0.21 

0.96 

-0.12 

0.00 

0.32 

0.99 

30974 

-0.06 

57 

37 

0.31 

1.14 

1.08 

1.04 

0.25 

0.00 

0.33 

0.73 

30975 

0.67 

56 

29 

0.30 

0.87 

-1.29 

0.81 

-0.98 

0.00 

0.53 

1.43 

30976 

-0.33 

50 

35 

0.33 

1.04 

0.31 

1.13 

0.61 

0.00 

0.29 

0.88 

30977 

0.56 

55 

30 

0.30 

0.89 

-0.97 

0.81 

-0.89 

0.00 

0.53 

1.34 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30978 

-0.26 

57 

39 

0.32 

0.94 

-0.41 

0.80 

-0.69 

0.00 

0.45 

1.18 

30979 

0.95 

57 

26 

0.29 

0.94 

-0.57 

0.96 

-0.23 

0.00 

0.43 

1.18 

30980 

2.46 

297 

111 

0.14 

1.13 

2.15 

1.17 

1.46 

0.00 

0.39 

0.72 

30981 

3.38 

56 

7 

0.47 

0.85 

-0.38 

3.31 

2.52 

0.00 

0.41 

0.94 

30982 

1.19 

56 

28 

0.30 

1.06 

0.54 

1.03 

0.24 

0.00 

0.44 

0.87 

30983 

0.07 

57 

34 

0.30 

1.22 

1.82 

1.43 

2.26 

0.00 

0.19 

0.32 

30984 

0.06 

55 

36 

0.31 

1.33 

2.39 

2.19 

3.77 

0.00 

0.03 

-0.01 

30985 

0.90 

59 

28 

0.29 

0.80 

-1.87 

0.75 

-1.57 

0.00 

0.60 

1.57 

30986 

-1.23 

56 

47 

0.38 

1.19 

0.85 

3.36 

3.50 

0.00 

-0.05 

0.59 

30987 

3.90 

57 

4 

0.54 

0.98 

0.10 

1.25 

0.56 

0.00 

0.20 

0.97 

30988 

2.94 

57 

9 

0.42 

1.18 

0.70 

4.15 

3.86 

0.00 

0.24 

0.70 

30989 

2.14 

55 

14 

0.35 

1.02 

0.18 

1.19 

0.64 

0.00 

0.40 

0.92 

30990 

-0.77 

57 

46 

0.36 

1.12 

0.63 

1.16 

0.51 

0.00 

0.21 

0.86 

30991 

1.22 

56 

23 

0.30 

0.89 

-1.06 

0.83 

-0.76 

0.00 

0.50 

1.36 

30992 

1.70 

56 

18 

0.32 

0.94 

-0.35 

1.63 

1.81 

0.00 

0.43 

0.94 

30993 

0.89 

47 

23 

0.33 

0.88 

-1.00 

0.79 

-0.95 

0.00 

0.55 

1.38 

30994 

2.06 

57 

16 

0.31 

0.93 

-0.42 

0.87 

-0.54 

0.00 

0.41 

1.14 

30995 

-0.13 

57 

40 

0.31 

0.88 

-0.91 

0.76 

-0.79 

0.00 

0.46 

1.29 

30996 

1.52 

56 

18 

0.32 

1.21 

1.40 

1.98 

3.38 

0.00 

0.17 

0.40 

30997 

1.85 

53 

15 

0.33 

0.95 

-0.28 

0.90 

-0.27 

0.00 

0.40 

1.10 

30998 

0.96 

56 

26 

0.29 

1.03 

0.32 

0.98 

-0.08 

0.00 

0.35 

0.94 

30999 

0.70 

56 

27 

0.31 

0.93 

-0.49 

0.88 

-0.50 

0.00 

0.54 

1.16 

31000 

2.19 

57 

13 

0.35 

1.09 

0.52 

2.31 

3.02 

0.00 

0.23 

0.72 

31001 

-3.03 

51 

49 

0.74 

1.01 

0.22 

0.51 

-0.10 

0.00 

0.23 

1.03 

31002 

-1.74 

55 

48 

0.44 

0.94 

-0.11 

0.59 

-0.75 

0.00 

0.45 

1.10 

31003 

-2.58 

42 

40 

0.74 

0.86 

-0.04 

0.62 

-0.13 

0.00 

0.31 

1.08 

31004 

-1.45 

53 

45 

0.41 

0.87 

-0.41 

0.58 

-0.80 

0.00 

0.47 

1.16 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

31005 

-3.37 

58 

56 

0.83 

0.66 

-0.34 

0.15 

-0.73 

0.00 

0.55 

1.17 

31006 

-1.24 

38 

32 

0.51 

0.87 

-0.32 

0.63 

-0.48 

0.00 

0.54 

1.14 

31007 

0.50 

55 

30 

0.30 

1.09 

0.90 

1.06 

0.42 

0.00 

0.32 

0.72 

31008 

-1.59 

47 

41 

0.48 

0.99 

0.08 

0.87 

0.03 

0.00 

0.38 

1.01 

31009 

1.26 

49 

22 

0.33 

1.37 

2.54 

1.63 

2.15 

0.00 

0.19 

0.01 

31010 

-2.01 

53 

47 

0.47 

0.89 

-0.23 

0.66 

-0.39 

0.00 

0.38 

1.10 

31011 

1.19 

56 

22 

0.30 

1.13 

1.09 

1.15 

0.82 

0.00 

0.30 

0.65 

31012 

-2.54 

39 

37 

0.75 

0.78 

-0.18 

0.40 

-0.55 

0.00 

0.48 

1.13 

31013 

-2.05 

45 

41 

0.55 

0.92 

-0.08 

0.68 

-0.23 

0.00 

0.34 

1.08 

31014 

-0.57 

48 

36 

0.36 

1.04 

0.28 

1.13 

0.53 

0.00 

0.31 

0.90 

31015 

-3.30 

42 

41 

1.03 

0.96 

0.26 

0.33 

-0.18 

0.00 

0.25 

1.06 

31016 

-0.38 

48 

37 

0.37 

1.06 

0.37 

1.11 

0.41 

0.00 

0.31 

0.92 

31017 

-2.48 

44 

42 

0.74 

0.87 

-0.02 

0.33 

-0.62 

0.00 

0.36 

1.12 

31018 

0.46 

45 

29 

0.34 

1.15 

1.09 

1.30 

1.07 

0.00 

0.27 

0.56 

31019 

-1.71 

36 

32 

0.54 

0.87 

-0.21 

0.57 

-0.40 

0.00 

0.36 

1.14 

31020 

-0.41 

45 

32 

0.35 

1.01 

0.09 

0.93 

-0.17 

0.00 

0.35 

1.01 

31021 

-1.57 

50 

44 

0.46 

0.94 

-0.08 

1.04 

0.26 

0.00 

0.33 

1.04 

31022 

-2.19 

45 

42 

0.62 

0.78 

-0.33 

0.35 

-0.81 

0.00 

0.46 

1.17 

31023 

2.51 

38 

8 

0.43 

0.91 

-0.31 

0.75 

-0.49 

0.00 

0.43 

1.14 

31024 

1.47 

47 

16 

0.33 

0.87 

-0.99 

0.88 

-0.65 

0.00 

0.49 

1.31 

31025 

0.99 

43 

21 

0.33 

1.17 

1.51 

1.23 

1.63 

0.00 

0.21 

0.26 

31026 

2.32 

56 

12 

0.36 

1.17 

0.89 

1.46 

1.02 

0.00 

0.27 

0.72 

31027 

-1.74 

57 

51 

0.46 

0.85 

-0.42 

0.71 

-0.30 

0.00 

0.41 

1.13 

31028 

-0.59 

55 

41 

0.33 

0.84 

-1.01 

0.67 

-0.82 

0.00 

0.48 

1.31 

31029 

-2.07 

57 

51 

0.46 

0.74 

-0.83 

0.60 

-0.47 

0.00 

0.48 

1.19 

31030 

-2.45 

57 

53 

0.54 

0.93 

-0.03 

0.82 

0.00 

0.00 

0.30 

1.03 

31031 

-1.84 

55 

49 

0.47 

0.75 

-0.73 

0.42 

-0.90 

0.00 

0.50 

1.21 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

31032 

-2.61 

55 

52 

0.64 

1.29 

0.69 

1.60 

0.87 

0.00 

0.07 

0.83 

31033 

-2.82 

54 

51 

0.65 

0.93 

0.02 

0.46 

-0.37 

0.00 

0.37 

1.07 

31034 

-1.60 

50 

44 

0.47 

1.11 

0.44 

1.63 

1.10 

0.00 

0.20 

0.87 

31035 

0.03 

56 

37 

0.31 

1.07 

0.55 

1.05 

0.28 

0.00 

0.38 

0.87 

31036 

0.14 

56 

35 

0.30 

1.04 

0.41 

1.14 

0.66 

0.00 

0.31 

0.81 

31037 

-0.96 

57 

47 

0.37 

0.93 

-0.28 

0.75 

-0.36 

0.00 

0.38 

1.10 

31038 

-0.44 

56 

42 

0.35 

1.24 

1.43 

2.92 

3.04 

0.00 

0.18 

0.39 

31039 

-3.64 

57 

56 

1.02 

0.84 

0.13 

0.15 

-0.59 

0.00 

0.30 

1.12 

31040 

0.14 

57 

37 

0.31 

0.84 

-1.25 

0.74 

-1.16 

0.00 

0.56 

1.38 

31041 

0.34 

56 

35 

0.30 

0.82 

-1.65 

0.71 

-1.14 

0.00 

0.55 

1.51 

31042 

-0.30 

57 

39 

0.31 

1.04 

0.35 

0.95 

-0.16 

0.00 

0.35 

0.96 

31043 

-0.08 

58 

39 

0.31 

0.94 

-0.37 

0.82 

-0.60 

0.00 

0.48 

1.15 

31044 

-0.89 

53 

41 

0.37 

0.89 

-0.47 

0.68 

-0.60 

0.00 

0.52 

1.17 

31045 

-1.36 

51 

42 

0.40 

0.85 

-0.61 

0.67 

-0.72 

0.00 

0.49 

1.18 

31046 

-0.34 

58 

42 

0.32 

0.95 

-0.29 

0.87 

-0.48 

0.00 

0.43 

1.11 

31047 

-0.08 

55 

36 

0.32 

0.80 

-1.60 

0.67 

-1.35 

0.00 

0.59 

1.47 

31048 

1.23 

291 

173 

0.14 

1.04 

0.75 

1.16 

1.51 

0.00 

0.42 

0.87 

31049 

-1.89 

58 

53 

0.49 

0.87 

-0.26 

0.47 

-0.69 

0.00 

0.37 

1.13 

31050 

1.64 

54 

17 

0.34 

0.91 

-0.53 

0.94 

-0.14 

0.00 

0.54 

1.13 

31051 

0.40 

56 

33 

0.30 

1.08 

0.71 

1.05 

0.32 

0.00 

0.37 

0.81 

31052 

0.82 

62 

30 

0.29 

0.80 

-1.91 

1.31 

1.51 

0.00 

0.56 

1.39 

31053 

1.58 

55 

18 

0.33 

1.05 

0.38 

1.36 

1.29 

0.00 

0.39 

0.83 

31054 

2.06 

57 

13 

0.34 

1.16 

0.90 

1.60 

1.96 

0.00 

0.13 

0.68 

31055 

1.90 

56 

15 

0.34 

1.07 

0.43 

1.36 

1.28 

0.00 

0.37 

0.82 

31056 

2.00 

56 

15 

0.33 

1.00 

0.07 

1.03 

0.20 

0.00 

0.36 

0.98 

31057 

-0.80 

56 

44 

0.36 

0.94 

-0.22 

0.75 

-0.54 

0.00 

0.44 

1.11 

31058 

-0.16 

55 

35 

0.32 

0.86 

-1.06 

0.82 

-0.58 

0.00 

0.53 

1.30 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

31059 

-1.52 

62 

55 

0.42 

1.14 

0.57 

1.62 

1.14 

0.00 

0.05 

0.83 

31060 

0.08 

57 

36 

0.31 

1.17 

1.32 

1.18 

0.83 

0.00 

0.31 

0.61 

31061 

-0.10 

53 

36 

0.33 

1.06 

0.48 

1.25 

0.87 

0.00 

0.37 

0.81 

31062 

-0.27 

56 

38 

0.31 

0.85 

-1.12 

0.76 

-1.12 

0.00 

0.54 

1.34 

31063 

-1.10 

56 

48 

0.41 

0.93 

-0.18 

0.87 

-0.10 

0.00 

0.38 

1.07 

31064 

-0.98 

57 

45 

0.35 

0.82 

-1.01 

0.66 

-0.90 

0.00 

0.48 

1.27 

31065 

1.59 

53 

16 

0.33 

1.08 

0.58 

1.48 

1.58 

0.00 

0.27 

0.74 

31066 

1.21 

54 

21 

0.31 

1.03 

0.31 

1.13 

0.64 

0.00 

0.37 

0.86 

31067 

1.81 

53 

16 

0.33 

1.28 

1.83 

1.90 

2.32 

0.00 

0.15 

0.33 

31068 

-0.53 

69 

55 

0.32 

0.90 

-0.53 

1.03 

0.20 

0.00 

0.39 

1.08 

31069 

-0.59 

56 

41 

0.33 

0.93 

-0.42 

0.85 

-0.40 

0.00 

0.42 

1.13 

31070 

0.22 

279 

211 

0.16 

0.98 

-0.30 

0.96 

-0.15 

0.00 

0.43 

1.03 

31071 

1.86 

56 

17 

0.32 

0.92 

-0.50 

0.87 

-0.51 

0.00 

0.50 

1.15 

31072 

2.53 

57 

12 

0.35 

1.19 

1.02 

1.61 

1.70 

0.00 

0.12 

0.67 

31073 

2.01 

74 

25 

0.27 

1.16 

1.30 

1.26 

1.33 

0.00 

0.27 

0.64 

31074 

-0.46 

54 

39 

0.33 

0.93 

-0.43 

0.74 

-0.87 

0.00 

0.45 

1.19 

31075 

0.00 

57 

38 

0.32 

1.30 

1.99 

1.64 

2.06 

0.00 

0.18 

0.32 

31076 

0.32 

56 

33 

0.29 

1.06 

0.65 

1.09 

0.52 

0.00 

0.31 

0.77 

31077 

-0.14 

56 

37 

0.31 

0.97 

-0.20 

1.00 

0.10 

0.00 

0.40 

1.03 

31078 

1.66 

58 

21 

0.29 

0.78 

-2.30 

0.71 

-1.83 

0.00 

0.58 

1.72 

31079 

0.96 

53 

22 

0.31 

1.02 

0.22 

1.10 

0.41 

0.00 

0.37 

0.89 

31080 

1.78 

64 

21 

0.29 

1.00 

0.02 

1.42 

1.74 

0.00 

0.37 

0.91 

31081 

2.05 

59 

17 

0.32 

1.14 

0.91 

1.06 

0.30 

0.00 

0.32 

0.80 

31082 

-0.22 

54 

40 

0.34 

1.28 

1.60 

1.29 

1.15 

0.00 

0.11 

0.58 

31083 

0.71 

57 

31 

0.29 

1.13 

1.21 

1.34 

2.23 

0.00 

0.23 

0.45 

31084 

0.33 

46 

27 

0.33 

1.07 

0.60 

0.94 

-0.15 

0.00 

0.40 

0.88 

31085 

0.77 

58 

31 

0.29 

0.79 

-2.26 

0.71 

-2.03 

0.00 

0.60 

1.75 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

31086 

-1.12 

60 

50 

0.37 

1.04 

0.24 

0.76 

-0.53 

0.00 

0.35 

1.02 

31087 

0.04 

56 

39 

0.32 

0.86 

-0.98 

0.75 

-1.01 

0.00 

0.53 

1.29 

31088 

-1.49 

56 

49 

0.43 

0.99 

0.07 

0.73 

-0.33 

0.00 

0.32 

1.04 

31089 

0.38 

57 

34 

0.30 

1.03 

0.29 

0.99 

0.01 

0.00 

0.41 

0.94 

31090 

-0.87 

55 

46 

0.39 

0.73 

-1.19 

0.49 

-1.43 

0.00 

0.61 

1.29 

31091 

0.77 

53 

27 

0.31 

0.81 

-1.59 

0.76 

-1.58 

0.00 

0.61 

1.52 

31092 

-0.89 

57 

46 

0.36 

0.90 

-0.50 

0.62 

-1.01 

0.00 

0.44 

1.20 

31093 

0.57 

54 

28 

0.31 

0.92 

-0.66 

0.87 

-0.60 

0.00 

0.50 

1.24 

31094 

-0.74 

56 

43 

0.34 

0.86 

-0.76 

0.75 

-0.71 

0.00 

0.49 

1.21 

31095 

0.05 

57 

38 

0.31 

0.86 

-1.12 

0.75 

-1.36 

0.00 

0.51 

1.37 

31096 

-1.76 

298 

283 

0.28 

0.93 

-0.26 

0.47 

-1.36 

0.00 

0.30 

1.08 

31097 

0.78 

56 

28 

0.31 

0.84 

-1.23 

0.79 

-1.03 

0.00 

0.60 

1.36 

31098 

-1.31 

283 

261 

0.24 

0.91 

-0.49 

0.50 

-1.74 

0.00 

0.39 

1.10 

31099 

0.49 

54 

27 

0.31 

0.89 

-0.86 

0.85 

-0.75 

0.00 

0.54 

1.28 

31100 

-0.80 

55 

42 

0.35 

1.25 

1.41 

1.51 

1.24 

0.00 

0.18 

0.61 

31151 

-0.99 

40 

33 

0.45 

1.30 

1.11 

1.92 

1.72 

0.00 

0.08 

0.63 

31152 

-1.28 

54 

45 

0.40 

1.04 

0.23 

0.98 

0.10 

0.00 

0.31 

0.96 

31153 

1.35 

57 

20 

0.30 

1.02 

0.21 

0.97 

-0.10 

0.00 

0.39 

0.98 

31154 

1.11 

65 

30 

0.28 

1.06 

0.57 

1.04 

0.32 

0.00 

0.38 

0.84 

31155 

-0.29 

59 

42 

0.31 

0.88 

-0.78 

0.93 

-0.22 

0.00 

0.48 

1.18 

31156 

-0.67 

46 

35 

0.38 

1.01 

0.12 

1.40 

1.20 

0.00 

0.32 

0.89 

31157 

-0.70 

43 

33 

0.39 

1.00 

0.07 

0.87 

-0.20 

0.00 

0.38 

1.03 

31158 

-3.45 

54 

52 

0.85 

0.78 

-0.10 

0.41 

-0.22 

0.00 

0.42 

1.09 

31159 

-2.25 

35 

32 

0.65 

0.95 

0.05 

2.50 

1.42 

0.00 

0.26 

0.92 

31160 

-2.05 

60 

55 

0.48 

1.09 

0.36 

0.87 

0.00 

0.00 

0.18 

0.96 

31161 

1.50 

66 

29 

0.27 

0.99 

-0.03 

0.96 

-0.21 

0.00 

0.42 

1.03 

31162 

-2.54 

41 

38 

0.71 

0.51 

-0.92 

0.14 

-0.90 

0.00 

0.65 

1.28 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

31163 

-0.54 

49 

38 

0.36 

0.92 

-0.40 

0.83 

-0.51 

0.00 

0.41 

1.13 

31164 

0.32 

57 

31 

0.30 

0.90 

-0.84 

0.98 

-0.01 

0.00 

0.49 

1.20 

31165 

0.31 

63 

35 

0.28 

0.88 

-1.15 

0.82 

-1.20 

0.00 

0.53 

1.38 

31166 

2.46 

54 

9 

0.39 

1.00 

0.06 

0.93 

0.00 

0.00 

0.31 

1.01 

31167 

-0.35 

55 

38 

0.33 

0.89 

-0.76 

0.81 

-0.58 

0.00 

0.51 

1.22 

31168 

-0.85 

69 

55 

0.32 

0.93 

-0.32 

0.80 

-0.52 

0.00 

0.41 

1.11 

31169 

-0.06 

48 

31 

0.34 

0.88 

-0.76 

0.85 

-0.46 

0.00 

0.53 

1.23 

31170 

1.06 

66 

28 

0.28 

1.11 

1.07 

1.05 

0.37 

0.00 

0.34 

0.73 

31171 

2.39 

64 

12 

0.36 

1.05 

0.29 

1.09 

0.36 

0.00 

0.36 

0.93 

31172 

-0.67 

57 

43 

0.33 

0.87 

-0.78 

0.82 

-0.54 

0.00 

0.45 

1.20 

31173 

1.61 

54 

17 

0.32 

0.97 

-0.20 

0.88 

-0.16 

0.00 

0.42 

1.09 

31174 

0.00 

60 

39 

0.30 

0.94 

-0.41 

0.83 

-0.64 

0.00 

0.50 

1.16 

31175 

0.56 

53 

32 

0.31 

1.06 

0.51 

1.13 

0.66 

0.00 

0.36 

0.81 

31176 

-0.46 

57 

39 

0.32 

0.94 

-0.40 

0.74 

-0.76 

0.00 

0.52 

1.18 

31177 

-1.00 

53 

42 

0.38 

0.97 

-0.04 

0.76 

-0.42 

0.00 

0.46 

1.07 

31178 

-0.05 

58 

40 

0.33 

1.16 

1.02 

1.32 

1.07 

0.00 

0.35 

0.70 

31179 

-1.92 

56 

51 

0.48 

0.81 

-0.46 

0.39 

-0.85 

0.00 

0.41 

1.18 

31180 

-1.68 

38 

33 

0.58 

1.26 

0.71 

1.18 

0.49 

0.00 

0.42 

0.85 

31181 

-2.54 

48 

45 

0.70 

1.02 

0.23 

1.34 

0.64 

0.00 

0.36 

0.94 

31182 

-2.01 

43 

39 

0.56 

0.93 

-0.05 

0.83 

0.14 

0.00 

0.33 

1.04 

31183 

-0.31 

54 

37 

0.32 

0.85 

-1.09 

1.20 

0.82 

0.00 

0.50 

1.22 

31184 

-0.38 

56 

40 

0.34 

1.29 

1.68 

1.37 

1.03 

0.00 

0.25 

0.52 

31185 

-1.91 

45 

40 

0.51 

0.83 

-0.41 

0.59 

-0.34 

0.00 

0.43 

1.15 

31186 

-3.32 

37 

36 

1.02 

1.00 

0.31 

0.56 

0.10 

0.00 

0.17 

1.02 

31187 

-3.15 

54 

52 

0.74 

0.71 

-0.30 

0.17 

-0.90 

0.00 

0.46 

1.18 

31188 

-3.06 

56 

54 

0.75 

0.92 

0.08 

0.26 

-0.69 

0.00 

0.38 

1.10 

31189 

0.91 

60 

31 

0.29 

1.01 

0.15 

1.07 

0.52 

0.00 

0.40 

0.92 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

31190 

1.53 

57 

20 

0.32 

1.15 

1.03 

1.37 

1.38 

0.00 

0.35 

0.68 

31191 

0.97 

54 

26 

0.30 

0.94 

-0.53 

0.87 

-0.66 

0.00 

0.49 

1.21 

31192 

-0.09 

59 

37 

0.30 

0.98 

-0.12 

0.98 

-0.02 

0.00 

0.41 

1.03 

31193 

-2.60 

45 

43 

0.76 

0.64 

-0.48 

0.15 

-0.82 

0.00 

0.53 

1.22 

31194 

0.96 

56 

26 

0.30 

0.96 

-0.26 

1.10 

0.54 

0.00 

0.47 

1.03 

31195 

-0.13 

56 

35 

0.31 

0.99 

-0.02 

0.88 

-0.42 

0.00 

0.46 

1.07 

31196 

-2.02 

47 

43 

0.54 

1.08 

0.32 

1.02 

0.32 

0.00 

0.12 

0.94 

31197 

0.86 

36 

18 

0.37 

1.32 

2.22 

1.40 

2.05 

0.00 

0.10 

-0.04 

31198 

-3.66 

46 

45 

1.04 

1.02 

0.33 

0.36 

-0.14 

0.00 

0.23 

1.03 

31200 

-2.79 

43 

41 

0.76 

1.05 

0.28 

0.38 

-0.22 

0.00 

0.32 

1.04 

31201 

-2.53 

36 

34 

0.76 

0.79 

-0.19 

0.28 

-0.43 

0.00 

0.43 

1.16 

31202 

-3.16 

41 

40 

1.02 

1.08 

0.39 

4.09 

1.75 

0.00 

-0.15 

0.84 

31203 

0.00 

40 

40 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

31204 

-0.45 

60 

41 

0.31 

1.05 

0.40 

1.18 

0.67 

0.00 

0.39 

0.87 

31205 

0.11 

44 

28 

0.34 

0.91 

-0.61 

0.88 

-0.48 

0.00 

0.48 

1.21 

31206 

0.00 

45 

45 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

31208 

-0.68 

40 

30 

0.40 

1.01 

0.11 

0.81 

-0.33 

0.00 

0.38 

1.04 

31209 

0.78 

37 

18 

0.36 

1.13 

1.08 

1.13 

0.83 

0.00 

0.24 

0.53 

31210 

-1.84 

43 

39 

0.56 

0.81 

-0.40 

0.38 

-0.89 

0.00 

0.51 

1.18 

31212 

-1.53 

39 

35 

0.55 

0.96 

0.04 

0.65 

-0.35 

0.00 

0.31 

1.06 

31213 

-1.54 

61 

54 

0.42 

1.10 

0.43 

0.87 

-0.06 

0.00 

0.21 

0.96 

31214 

-0.04 

52 

33 

0.32 

1.01 

0.09 

1.10 

0.55 

0.00 

0.40 

0.95 

31215 

-0.81 

57 

44 

0.35 

0.95 

-0.22 

0.80 

-0.27 

0.00 

0.45 

1.08 

31216 

-0.27 

61 

42 

0.32 

0.68 

-2.45 

0.51 

-2.01 

0.00 

0.68 

1.58 

31217 

-0.69 

57 

44 

0.34 

1.39 

2.03 

2.40 

2.88 

0.00 

0.02 

0.35 

31218 

0.16 

57 

36 

0.31 

1.19 

1.52 

1.08 

0.41 

0.00 

0.32 

0.61 

31219 

-0.31 

56 

36 

0.31 

0.96 

-0.25 

0.93 

-0.28 

0.00 

0.44 

1.09 

easyCBM  CCSS  Third  Grade  Math  Measure  Development 


207 

Appendix  D:  Item  Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

31220 

0.80 

57 

24 

0.28 

0.90 

-1.20 

0.86 

-1.14 

0.00 

0.46 

1.48 

31221 

-0.41 

48 

35 

0.34 

0.90 

-0.66 

0.77 

-0.87 

0.00 

0.45 

1.24 

31222 

-0.25 

61 

44 

0.31 

0.91 

-0.51 

0.79 

-0.78 

0.00 

0.49 

1.17 

31223 

0.44 

3057 

1729 

0.04 

0.96 

-2.40 

0.97 

-1.32 

0.00 

0.45 

1.10 

31224 

1.10 

49 

19 

0.32 

0.78 

-1.82 

0.75 

-1.29 

0.00 

0.60 

1.55 

31225 

0.70 

56 

28 

0.30 

0.95 

-0.43 

0.95 

-0.27 

0.00 

0.49 

1.14 

3G11 

0.91 

117 

70 

0.21 

0.94 

-0.62 

0.87 

-0.92 

0.00 

0.50 

1.17 

3G110 

-1.27 

251 

235 

0.27 

0.87 

-0.61 

0.53 

-1.24 

0.00 

0.35 

1.10 

3G111 

-1.29 

113 

106 

0.41 

1.07 

0.32 

1.27 

0.58 

0.00 

0.19 

0.93 

3G112 

-0.17 

119 

102 

0.28 

1.20 

1.15 

1.31 

0.91 

0.00 

0.15 

0.79 

3G113 

-3.39 

124 

123 

1.01 

1.04 

0.37 

7.69 

2.99 

0.00 

-0.10 

0.86 

3G114 

0.57 

130 

96 

0.22 

1.05 

0.47 

1.13 

0.65 

0.00 

0.38 

0.91 

3G115 

-1.26 

118 

110 

0.38 

1.01 

0.13 

1.02 

0.22 

0.00 

0.18 

0.98 

3G116 

-1.37 

133 

127 

0.43 

1.08 

0.35 

1.94 

1.34 

0.00 

0.06 

0.89 

3G117 

0.86 

113 

85 

0.24 

0.87 

-1.07 

0.73 

-1.11 

0.00 

0.50 

1.21 

3G118 

0.11 

108 

83 

0.25 

1.03 

0.31 

0.92 

-0.21 

0.00 

0.38 

0.98 

3G119 

-0.69 

225 

202 

0.23 

0.90 

-0.55 

0.68 

-1.12 

0.00 

0.37 

1.09 

3G12 

-1.53 

110 

107 

0.60 

0.94 

0.06 

0.29 

-0.82 

0.00 

0.25 

1.08 

3G120 

1.78 

112 

64 

0.21 

1.16 

1.99 

1.34 

2.45 

0.00 

0.27 

0.43 

3G121 

1.58 

130 

73 

0.20 

1.03 

0.44 

0.96 

-0.22 

0.00 

0.45 

0.95 

3G122 

0.45 

118 

92 

0.25 

1.14 

1.08 

1.15 

0.59 

0.00 

0.31 

0.80 

3G123 

0.36 

120 

94 

0.24 

1.02 

0.23 

1.08 

0.43 

0.00 

0.30 

0.95 

3G124 

0.85 

118 

83 

0.23 

1.05 

0.49 

0.94 

-0.31 

0.00 

0.41 

0.96 

3G125 

0.00 

110 

85 

0.25 

1.13 

1.02 

1.02 

0.16 

0.00 

0.29 

0.85 

3G126 

-0.68 

107 

96 

0.35 

0.86 

-0.60 

1.00 

0.18 

0.00 

0.40 

1.09 

3G127 

-1.42 

116 

110 

0.43 

0.92 

-0.13 

0.62 

-0.46 

0.00 

0.28 

1.06 

3G128 

2.17 

120 

56 

0.21 

0.87 

-1.69 

0.83 

-1.40 

0.00 

0.54 

1.36 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

3G129 

0.86 

125 

86 

0.22 

1.08 

0.78 

1.14 

0.76 

0.00 

0.39 

0.86 

3G13 

0.13 

116 

92 

0.25 

0.97 

-0.16 

1.01 

0.14 

0.00 

0.35 

1.03 

3G130 

1.03 

125 

90 

0.22 

1.01 

0.09 

0.90 

-0.48 

0.00 

0.41 

1.02 

3G131 

1.63 

111 

69 

0.22 

0.98 

-0.21 

0.92 

-0.46 

0.00 

0.46 

1.07 

3G132 

0.89 

106 

67 

0.23 

1.09 

1.02 

1.00 

0.03 

0.00 

0.39 

0.84 

3G133 

1.88 

108 

70 

0.23 

0.92 

-0.81 

0.89 

-0.64 

0.00 

0.51 

1.17 

3G134 

1.42 

111 

71 

0.22 

1.20 

2.24 

1.20 

1.28 

0.00 

0.25 

0.51 

3G135 

0.32 

121 

95 

0.24 

0.99 

-0.03 

0.81 

-0.64 

0.01 

0.36 

1.05 

3G136 

1.03 

241 

163 

0.15 

0.89 

-1.72 

0.79 

-1.61 

0.00 

0.51 

1.25 

3G137 

1.01 

115 

80 

0.23 

0.87 

-1.24 

0.71 

-1.50 

0.00 

0.54 

1.27 

3G138 

1.44 

116 

69 

0.21 

1.16 

1.90 

1.19 

1.45 

0.00 

0.27 

0.54 

3G139 

0.24 

107 

84 

0.26 

1.09 

0.69 

0.99 

0.02 

0.00 

0.32 

0.92 

3G14 

-2.02 

110 

105 

0.47 

0.90 

-0.12 

0.55 

-0.55 

0.00 

0.28 

1.07 

3G140 

-0.16 

107 

91 

0.30 

0.86 

-0.78 

1.09 

0.36 

0.00 

0.43 

1.08 

3G141 

1.38 

114 

71 

0.22 

1.20 

2.14 

1.22 

1.46 

0.00 

0.30 

0.54 

3G142 

1.77 

119 

65 

0.21 

1.08 

1.06 

1.30 

2.19 

0.00 

0.36 

0.69 

3G143 

1.40 

125 

74 

0.21 

0.89 

-1.20 

0.81 

-1.39 

0.00 

0.55 

1.26 

3G144 

0.92 

116 

77 

0.22 

1.10 

1.11 

1.08 

0.50 

0.00 

0.33 

0.78 

3G145 

0.64 

123 

96 

0.24 

0.91 

-0.68 

0.91 

-0.29 

0.00 

0.44 

1.12 

3G146 

1.34 

111 

75 

0.23 

1.02 

0.20 

0.92 

-0.39 

0.00 

0.43 

1.00 

3G147 

1.04 

106 

64 

0.22 

1.15 

1.63 

1.13 

0.84 

0.00 

0.34 

0.66 

3G148 

0.68 

106 

88 

0.28 

1.00 

0.05 

1.73 

1.90 

0.00 

0.30 

0.89 

3G149 

1.40 

110 

71 

0.22 

1.22 

2.39 

1.24 

1.45 

0.00 

0.23 

0.47 

3G15 

-0.26 

121 

104 

0.28 

0.99 

0.02 

0.73 

-0.64 

0.01 

0.32 

1.04 

3G150 

-0.60 

114 

102 

0.33 

1.28 

1.26 

1.78 

1.42 

0.00 

0.09 

0.72 

3G151 

-0.94 

116 

107 

0.36 

0.94 

-0.13 

0.57 

-0.89 

0.00 

0.30 

1.07 

3G152 

-3.42 

107 

106 

1.01 

0.88 

0.19 

0.11 

-0.95 

0.00 

0.26 

1.10 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

3G153 

-0.31 

108 

88 

0.27 

1.06 

0.43 

1.04 

0.24 

0.00 

0.29 

0.92 

3G154 

0.88 

107 

77 

0.25 

1.10 

0.84 

1.14 

0.68 

0.00 

0.44 

0.86 

3G155 

0.21 

225 

182 

0.19 

1.31 

2.79 

1.83 

3.21 

0.00 

0.17 

0.57 

3G156 

-1.39 

114 

108 

0.43 

0.89 

-0.21 

0.53 

-0.66 

0.00 

0.31 

1.09 

3G157 

0.49 

119 

92 

0.24 

1.09 

0.76 

1.14 

0.62 

0.00 

0.31 

0.88 

3G158 

1.28 

124 

76 

0.21 

0.91 

-1.03 

0.90 

-0.61 

0.00 

0.53 

1.18 

3G159 

0.61 

115 

83 

0.23 

1.14 

1.37 

1.08 

0.44 

0.00 

0.28 

0.77 

3G16 

-2.45 

123 

121 

0.72 

1.01 

0.24 

0.76 

0.04 

0.00 

0.13 

1.00 

3G160 

0.39 

111 

91 

0.27 

1.18 

1.17 

1.66 

1.79 

0.00 

0.19 

0.73 

3G161 

2.23 

106 

40 

0.23 

1.04 

0.41 

1.29 

1.79 

0.00 

0.42 

0.86 

3G162 

0.60 

106 

89 

0.29 

0.95 

-0.26 

0.94 

-0.05 

0.00 

0.38 

1.03 

3G163 

1.60 

109 

66 

0.22 

1.11 

1.32 

1.08 

0.60 

0.00 

0.33 

0.72 

3G164 

1.36 

119 

72 

0.21 

1.19 

2.31 

1.26 

1.60 

0.01 

0.29 

0.47 

3G165 

2.56 

113 

47 

0.22 

1.23 

2.27 

1.57 

3.21 

0.00 

0.33 

0.43 

3G166 

0.54 

116 

88 

0.23 

1.12 

1.02 

1.19 

0.90 

0.00 

0.23 

0.80 

3G167 

0.73 

106 

75 

0.23 

1.06 

0.61 

1.14 

0.78 

0.00 

0.34 

0.86 

3G168 

1.11 

111 

64 

0.22 

0.99 

-0.08 

0.96 

-0.28 

0.00 

0.45 

1.04 

3G169 

1.25 

246 

158 

0.15 

1.04 

0.71 

1.05 

0.49 

0.00 

0.40 

0.92 

3G17 

-0.69 

108 

97 

0.35 

1.12 

0.58 

1.23 

0.58 

0.00 

0.26 

0.88 

3G170 

2.50 

116 

47 

0.21 

1.22 

2.30 

1.35 

2.38 

0.00 

0.30 

0.47 

3G171 

1.82 

121 

65 

0.20 

1.14 

1.82 

1.23 

1.74 

0.00 

0.33 

0.54 

3G172 

3.05 

127 

37 

0.22 

1.43 

3.63 

2.28 

4.89 

0.00 

0.09 

0.12 

3G173 

2.91 

117 

34 

0.23 

1.43 

3.35 

1.63 

3.00 

0.00 

0.13 

0.31 

3G174 

1.71 

126 

75 

0.20 

0.99 

-0.09 

1.01 

0.15 

0.00 

0.44 

1.03 

3G175 

1.63 

111 

69 

0.22 

1.19 

1.97 

1.15 

0.95 

0.00 

0.32 

0.59 

3G176 

2.73 

106 

31 

0.24 

0.97 

-0.21 

1.14 

0.73 

0.00 

0.46 

1.00 

3G177 

-0.29 

109 

100 

0.37 

1.08 

0.38 

1.03 

0.24 

0.00 

0.23 

0.95 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

3G178 

-2.35 

111 

109 

0.72 

0.94 

0.13 

0.40 

-0.50 

0.00 

0.21 

1.06 

3G179 

-1.89 

220 

210 

0.33 

1.04 

0.24 

0.95 

0.06 

0.00 

0.17 

0.98 

3G18 

1.12 

122 

79 

0.21 

1.00 

0.03 

0.95 

-0.24 

0.01 

0.42 

1.03 

3G180 

0.66 

116 

87 

0.24 

1.11 

0.91 

1.02 

0.16 

0.00 

0.36 

0.86 

3G19 

0.05 

116 

96 

0.26 

1.03 

0.22 

1.05 

0.25 

0.00 

0.27 

0.95 

3G21 

-1.96 

108 

104 

0.53 

0.84 

-0.25 

0.48 

-0.60 

0.00 

0.34 

1.09 

3G210 

-1.51 

111 

103 

0.38 

0.86 

-0.41 

0.62 

-0.60 

0.00 

0.34 

1.10 

3G211 

-0.69 

108 

97 

0.35 

0.89 

-0.44 

0.77 

-0.29 

0.00 

0.40 

1.10 

3G212 

-1.42 

116 

110 

0.43 

0.92 

-0.12 

0.67 

-0.36 

0.00 

0.27 

1.06 

3G213 

-1.29 

121 

114 

0.40 

0.88 

-0.29 

0.93 

0.07 

0.00 

0.29 

1.06 

3G214 

0.08 

220 

191 

0.21 

0.97 

-0.18 

0.90 

-0.26 

0.00 

0.33 

1.02 

3G215 

-1.01 

127 

116 

0.33 

1.02 

0.16 

0.91 

-0.01 

0.00 

0.27 

0.99 

3G216 

-1.58 

117 

111 

0.43 

0.97 

0.03 

0.69 

-0.36 

0.00 

0.23 

1.03 

3G217 

-2.47 

126 

124 

0.72 

0.94 

0.14 

0.30 

-0.74 

0.00 

0.22 

1.06 

3G218 

-1.57 

111 

107 

0.52 

0.83 

-0.26 

0.23 

-1.24 

0.00 

0.35 

1.13 

3G219 

-1.74 

106 

100 

0.44 

0.91 

-0.16 

0.85 

0.01 

0.00 

0.27 

1.05 

3G22 

-0.29 

109 

100 

0.37 

0.98 

0.02 

1.79 

1.34 

0.00 

0.23 

0.95 

3G220 

-2.35 

111 

109 

0.72 

0.94 

0.14 

1.63 

0.87 

0.00 

0.12 

1.00 

3G23 

-1.47 

219 

207 

0.31 

0.99 

0.03 

0.85 

-0.15 

0.00 

0.24 

1.02 

3G24 

-1.95 

122 

118 

0.52 

0.98 

0.10 

0.62 

-0.32 

0.00 

0.18 

1.03 

3G25 

-0.84 

116 

106 

0.35 

0.75 

-1.02 

0.37 

-1.30 

0.00 

0.46 

1.20 

3G26 

-0.60 

116 

104 

0.32 

0.94 

-0.18 

0.86 

-0.21 

0.00 

0.30 

1.06 

3G27 

-0.78 

108 

97 

0.34 

1.00 

0.10 

1.17 

0.51 

0.00 

0.27 

0.98 

3G28 

-0.89 

107 

94 

0.31 

0.82 

-0.90 

0.94 

-0.01 

0.00 

0.40 

1.15 

3G29 

-2.22 

107 

104 

0.60 

1.04 

0.25 

0.46 

-0.37 

0.00 

0.20 

1.01 

3MD11 

0.00 

117 

88 

0.24 

1.07 

0.58 

1.23 

0.99 

0.00 

0.36 

0.87 

3MD110 

-0.29 

110 

95 

0.31 

0.90 

-0.49 

0.67 

-0.74 

0.00 

0.43 

1.11 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

3MD111 

0.66 

118 

88 

0.23 

0.87 

-1.12 

0.75 

-1.19 

0.00 

0.49 

1.22 

3MD112 

0.06 

123 

102 

0.26 

0.90 

-0.66 

0.67 

-1.11 

0.00 

0.43 

1.15 

3MD113 

1.47 

129 

75 

0.20 

0.96 

-0.44 

0.93 

-0.49 

0.00 

0.50 

1.09 

3MD12 

0.46 

117 

87 

0.23 

0.97 

-0.23 

0.80 

-0.88 

0.00 

0.41 

1.10 

3MD13 

2.35 

133 

63 

0.20 

1.12 

1.48 

1.18 

1.48 

0.00 

0.37 

0.67 

3MD14 

1.30 

113 

77 

0.23 

1.18 

1.75 

1.17 

0.92 

0.00 

0.31 

0.65 

3MD15 

1.24 

108 

62 

0.22 

1.07 

0.82 

1.08 

0.61 

0.00 

0.42 

0.82 

3MD16 

1.47 

220 

118 

0.15 

1.06 

0.96 

1.15 

1.71 

0.00 

0.39 

0.80 

3MD17 

0.45 

109 

93 

0.29 

1.03 

0.22 

0.88 

-0.21 

0.00 

0.34 

0.99 

3MD18 

1.27 

111 

74 

0.22 

0.88 

-1.37 

0.76 

-1.51 

0.00 

0.51 

1.32 

3MD19 

2.53 

129 

49 

0.21 

1.24 

2.35 

1.30 

1.94 

0.00 

0.33 

0.53 

3MD21 

0.32 

118 

94 

0.25 

0.93 

-0.48 

0.88 

-0.33 

0.00 

0.44 

1.08 

3MD210 

1.65 

119 

65 

0.20 

0.92 

-1.01 

0.86 

-1.22 

0.00 

0.48 

1.26 

3MD211 

-0.95 

117 

107 

0.35 

0.90 

-0.33 

0.60 

-0.85 

0.00 

0.40 

1.09 

3MD212 

-0.28 

111 

90 

0.26 

1.02 

0.16 

0.85 

-0.45 

0.00 

0.35 

1.01 

3MD213 

0.02 

107 

89 

0.29 

0.87 

-0.77 

0.62 

-1.11 

0.00 

0.50 

1.17 

3MD22 

-0.25 

224 

193 

0.21 

0.77 

-1.89 

0.45 

-2.42 

0.00 

0.51 

1.25 

3MD23 

0.79 

116 

84 

0.23 

0.94 

-0.48 

0.87 

-0.58 

0.00 

0.45 

1.10 

3MD24 

1.13 

121 

81 

0.21 

0.99 

-0.12 

0.93 

-0.37 

0.00 

0.42 

1.04 

3MD25 

0.83 

127 

88 

0.22 

0.80 

-2.14 

0.65 

-2.06 

0.00 

0.60 

1.39 

3MD26 

0.81 

117 

80 

0.22 

0.89 

-1.24 

0.77 

-1.27 

0.00 

0.49 

1.27 

3MD27 

1.89 

125 

70 

0.20 

0.96 

-0.53 

0.92 

-0.60 

0.00 

0.47 

1.13 

3MD28 

-1.33 

111 

106 

0.47 

0.88 

-0.20 

0.32 

-1.10 

0.00 

0.33 

1.11 

3MD29 

0.99 

106 

65 

0.22 

0.81 

-2.21 

0.70 

-2.02 

0.00 

0.60 

1.48 

3MD31 

0.62 

109 

91 

0.28 

0.93 

-0.37 

0.72 

-0.79 

0.00 

0.43 

1.10 

3MD310 

1.51 

111 

69 

0.22 

1.16 

1.87 

1.27 

1.76 

0.00 

0.27 

0.53 

3MD311 

1.42 

122 

72 

0.21 

0.87 

-1.76 

0.93 

-0.45 

0.01 

0.52 

1.31 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

3MD312 

0.60 

116 

88 

0.24 

0.77 

-2.02 

0.55 

-1.98 

0.00 

0.58 

1.37 

3MD313 

1.17 

116 

75 

0.21 

0.92 

-0.90 

0.98 

-0.07 

0.00 

0.44 

1.15 

3MD32 

1.85 

108 

53 

0.21 

1.21 

2.48 

1.46 

3.48 

0.00 

0.21 

0.27 

3MD33 

1.47 

110 

56 

0.21 

1.08 

0.95 

1.16 

1.33 

0.00 

0.38 

0.73 

3MD34 

0.34 

107 

85 

0.27 

1.21 

1.37 

1.12 

0.48 

0.00 

0.35 

0.79 

3MD35 

1.70 

116 

65 

0.21 

0.80 

-2.47 

0.77 

-1.97 

0.00 

0.60 

1.50 

3MD36 

2.22 

120 

55 

0.21 

1.10 

1.21 

1.30 

2.27 

0.00 

0.36 

0.64 

3MD37 

0.91 

125 

85 

0.22 

0.92 

-0.83 

0.83 

-0.93 

0.00 

0.51 

1.17 

3MD38 

1.44 

249 

149 

0.15 

1.25 

3.91 

1.37 

3.41 

0.00 

0.26 

0.37 

3MD39 

1.02 

116 

75 

0.22 

0.96 

-0.38 

0.91 

-0.48 

0.00 

0.44 

1.10 

3MD41 

-1.29 

125 

119 

0.43 

0.88 

-0.24 

0.44 

-0.86 

0.00 

0.34 

1.09 

3MD410 

2.91 

111 

42 

0.22 

1.28 

2.71 

1.69 

3.79 

0.00 

0.22 

0.26 

3MD411 

-0.83 

246 

225 

0.24 

0.87 

-0.73 

0.55 

-1.40 

0.00 

0.38 

1.12 

3MD412 

2.50 

106 

35 

0.23 

1.07 

0.64 

1.39 

2.02 

0.00 

0.39 

0.83 

3MD413 

3.06 

108 

46 

0.22 

0.83 

-2.00 

0.83 

-1.18 

0.00 

0.59 

1.39 

3MD42 

0.00 

111 

95 

0.29 

0.92 

-0.37 

0.71 

-0.81 

0.01 

0.38 

1.10 

3MD43 

0.38 

121 

94 

0.24 

1.19 

1.61 

2.53 

4.15 

0.01 

0.13 

0.56 

3MD44 

0.73 

115 

85 

0.24 

0.97 

-0.21 

0.80 

-0.83 

0.00 

0.46 

1.09 

3MD45 

1.22 

116 

74 

0.21 

1.23 

2.56 

1.26 

1.72 

0.00 

0.20 

0.42 

3MD46 

1.70 

107 

56 

0.21 

1.10 

1.18 

1.10 

0.84 

0.00 

0.35 

0.72 

3MD47 

0.61 

110 

74 

0.23 

0.81 

-2.09 

0.78 

-1.33 

0.00 

0.55 

1.39 

3MD48 

1.58 

107 

65 

0.24 

1.11 

1.07 

1.18 

1.10 

0.00 

0.47 

0.77 

3MD49 

2.20 

114 

53 

0.21 

1.14 

1.63 

1.23 

1.76 

0.00 

0.36 

0.60 

3MD51 

-0.98 

119 

110 

0.36 

0.98 

0.02 

1.06 

0.28 

0.00 

0.26 

1.01 

3MD510 

-0.01 

125 

102 

0.25 

0.93 

-0.45 

0.96 

-0.01 

0.00 

0.41 

1.06 

3MD511 

0.83 

116 

79 

0.22 

1.35 

3.43 

1.59 

2.74 

0.00 

0.10 

0.16 

3MD512 

1.55 

123 

77 

0.21 

1.18 

2.04 

1.17 

1.16 

0.00 

0.29 

0.60 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

3MD52 

-1.13 

218 

202 

0.27 

1.04 

0.27 

1.57 

1.28 

0.00 

0.19 

0.94 

3MD53 

-0.53 

111 

101 

0.35 

0.99 

0.04 

1.39 

0.82 

0.00 

0.24 

0.97 

3MD54 

-0.15 

106 

85 

0.26 

0.87 

-0.88 

1.00 

0.11 

0.00 

0.44 

1.12 

3MD55 

1.18 

106 

81 

0.25 

1.07 

0.55 

1.12 

0.54 

0.00 

0.35 

0.88 

3MD56 

3.03 

110 

36 

0.23 

1.10 

0.97 

1.20 

1.19 

0.00 

0.35 

0.78 

3MD57 

-1.32 

121 

114 

0.40 

0.99 

0.09 

0.80 

-0.14 

0.00 

0.20 

1.01 

3MD58 

-1.88 

114 

110 

0.52 

1.00 

0.15 

0.96 

0.23 

0.00 

0.18 

1.00 

3MD59 

-0.94 

116 

107 

0.36 

0.93 

-0.15 

0.70 

-0.54 

0.00 

0.29 

1.06 

3MD61 

3.19 

107 

26 

0.24 

0.96 

-0.33 

0.77 

-1.01 

0.00 

0.44 

1.12 

3MD610 

1.36 

108 

57 

0.22 

1.33 

3.59 

1.43 

3.16 

0.00 

0.20 

0.05 

3MD611 

2.29 

107 

52 

0.23 

1.44 

3.88 

1.80 

4.11 

0.00 

0.30 

-0.02 

3MD612 

2.83 

220 

91 

0.16 

1.10 

1.48 

1.15 

1.47 

0.00 

0.39 

0.76 

3MD62 

2.43 

114 

48 

0.22 

1.10 

1.09 

1.21 

1.52 

0.00 

0.39 

0.72 

3MD63 

3.64 

119 

26 

0.25 

0.95 

-0.31 

1.52 

1.83 

0.00 

0.45 

0.99 

3MD64 

-0.07 

124 

102 

0.26 

1.05 

0.39 

0.97 

0.03 

0.00 

0.35 

0.96 

3MD65 

-0.24 

114 

96 

0.27 

0.97 

-0.14 

0.77 

-0.60 

0.00 

0.35 

1.06 

3MD66 

-0.68 

123 

113 

0.35 

0.98 

0.01 

0.96 

0.08 

0.00 

0.26 

1.00 

3MD67 

1.34 

111 

75 

0.23 

1.13 

1.32 

1.16 

0.89 

0.00 

0.33 

0.72 

3MD68 

-0.01 

106 

83 

0.26 

0.99 

-0.01 

1.52 

1.66 

0.00 

0.35 

0.95 

3MD69 

0.76 

106 

87 

0.28 

0.82 

-1.16 

0.59 

-1.40 

0.00 

0.52 

1.23 

3MD71 

-0.05 

109 

94 

0.29 

0.97 

-0.10 

0.76 

-0.59 

0.01 

0.34 

1.06 

3MD710 

3.00 

119 

36 

0.23 

1.01 

0.16 

1.08 

0.51 

0.00 

0.47 

0.96 

3MD711 

2.23 

111 

52 

0.22 

1.25 

2.55 

1.42 

2.68 

0.00 

0.32 

0.38 

3MD712 

2.38 

116 

47 

0.21 

1.00 

0.06 

1.02 

0.19 

0.00 

0.42 

0.98 

3MD72 

0.25 

106 

83 

0.26 

0.98 

-0.12 

0.91 

-0.29 

0.00 

0.41 

1.04 

3MD73 

-0.38 

114 

100 

0.30 

1.08 

0.48 

1.19 

0.58 

0.00 

0.23 

0.92 

3MD74 

2.78 

119 

42 

0.22 

1.21 

2.06 

1.49 

2.75 

0.00 

0.29 

0.49 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

3MD75 

0.88 

123 

84 

0.22 

1.21 

2.03 

1.26 

1.36 

0.00 

0.30 

0.61 

3MD76 

2.78 

241 

85 

0.16 

1.47 

5.55 

1.89 

6.29 

0.00 

0.15 

0.08 

3MD77 

2.39 

114 

43 

0.22 

1.06 

0.62 

1.07 

0.56 

0.00 

0.41 

0.88 

3MD78 

2.91 

122 

44 

0.21 

1.05 

0.58 

1.39 

2.43 

0.00 

0.36 

0.79 

3MD79 

3.37 

110 

33 

0.24 

1.16 

1.41 

1.52 

2.35 

0.00 

0.31 

0.65 

3MD81 

0.05 

106 

82 

0.25 

1.00 

0.07 

1.54 

1.75 

0.00 

0.32 

0.88 

3MD810 

1.88 

106 

69 

0.23 

1.31 

2.81 

1.72 

3.57 

0.00 

0.20 

0.25 

3MD811 

1.06 

109 

77 

0.23 

1.01 

0.13 

1.30 

1.49 

0.00 

0.33 

0.88 

3MD812 

2.14 

119 

54 

0.21 

0.92 

-0.86 

0.90 

-0.76 

0.00 

0.53 

1.18 

3MD82 

-0.59 

225 

200 

0.22 

0.85 

-0.96 

0.65 

-1.33 

0.00 

0.41 

1.13 

3MD83 

0.60 

110 

83 

0.25 

0.78 

-1.86 

1.08 

0.38 

0.00 

0.54 

1.28 

3MD84 

3.62 

116 

23 

0.26 

1.11 

0.78 

1.41 

1.55 

0.00 

0.27 

0.81 

3MD85 

0.31 

106 

82 

0.25 

0.77 

-1.86 

0.56 

-2.15 

0.00 

0.60 

1.35 

3MD86 

1.90 

107 

45 

0.22 

1.10 

1.13 

1.30 

2.15 

0.00 

0.36 

0.66 

3MD87 

0.82 

107 

78 

0.25 

1.16 

1.26 

1.04 

0.26 

0.00 

0.41 

0.81 

3MD88 

-0.38 

114 

100 

0.30 

0.83 

-0.83 

0.49 

-1.44 

0.00 

0.45 

1.19 

3MD89 

1.89 

118 

62 

0.21 

1.00 

0.07 

1.03 

0.31 

0.00 

0.44 

0.97 

3NBT11 

-0.01 

328 

265 

0.15 

0.92 

-0.98 

0.79 

-1.30 

0.00 

0.44 

1.11 

3NBT110 

0.58 

117 

77 

0.22 

1.07 

0.74 

1.07 

0.46 

0.00 

0.40 

0.87 

3NBT111 

0.29 

109 

87 

0.27 

0.87 

-0.90 

0.80 

-0.60 

0.00 

0.50 

1.15 

3NBT112 

0.98 

117 

81 

0.22 

1.01 

0.12 

1.16 

0.92 

0.00 

0.39 

0.93 

3NBT113 

0.43 

123 

96 

0.24 

1.02 

0.16 

1.00 

0.08 

0.00 

0.35 

0.97 

3NBT114 

1.13 

129 

83 

0.21 

1.03 

0.33 

0.98 

-0.06 

0.00 

0.44 

0.96 

3NBT115 

0.72 

117 

82 

0.22 

1.06 

0.63 

0.99 

0.01 

0.00 

0.35 

0.91 

3NBT116 

0.96 

131 

96 

0.22 

1.16 

1.49 

1.09 

0.53 

0.00 

0.29 

0.76 

3NBT117 

1.09 

113 

81 

0.23 

1.05 

0.46 

0.96 

-0.14 

0.00 

0.40 

0.95 

3NBT118 

0.52 

108 

76 

0.23 

0.90 

-1.00 

0.78 

-1.09 

0.00 

0.51 

1.22 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

3NBT119 

1.53 

109 

77 

0.24 

0.94 

-0.52 

0.79 

-1.04 

0.00 

0.49 

1.15 

3NBT12 

0.69 

111 

85 

0.24 

0.90 

-0.82 

0.74 

-1.15 

0.00 

0.45 

1.18 

3NBT120 

2.07 

129 

60 

0.20 

1.09 

1.11 

1.06 

0.48 

0.00 

0.42 

0.80 

3NBT121 

0.84 

118 

85 

0.23 

1.22 

1.90 

1.47 

1.90 

0.00 

0.29 

0.62 

3NBT122 

0.97 

119 

81 

0.21 

0.91 

-1.03 

0.84 

-1.02 

0.00 

0.46 

1.22 

3NBT123 

-0.07 

115 

96 

0.27 

1.14 

0.88 

1.11 

0.46 

0.00 

0.27 

0.88 

3NBT124 

0.30 

110 

80 

0.24 

1.09 

0.82 

1.02 

0.19 

0.00 

0.33 

0.87 

3NBT125 

1.06 

235 

160 

0.15 

0.93 

-1.13 

0.85 

-1.19 

0.01 

0.46 

1.18 

3NBT126 

0.41 

107 

84 

0.27 

1.01 

0.13 

0.85 

-0.45 

0.00 

0.45 

1.02 

3NBT127 

1.14 

116 

77 

0.22 

1.10 

1.05 

1.13 

0.81 

0.00 

0.35 

0.79 

3NBT128 

0.10 

120 

99 

0.26 

0.95 

-0.28 

1.44 

1.38 

0.00 

0.33 

0.99 

3NBT129 

2.03 

127 

60 

0.20 

1.15 

1.76 

1.23 

1.77 

0.00 

0.37 

0.62 

3NBT13 

0.24 

117 

91 

0.24 

0.86 

-1.18 

0.67 

-1.33 

0.00 

0.47 

1.24 

3NBT130 

0.11 

125 

106 

0.27 

0.90 

-0.56 

0.63 

-1.19 

0.00 

0.44 

1.13 

3NBT131 

0.66 

111 

87 

0.25 

1.18 

1.33 

1.84 

2.51 

0.00 

0.21 

0.69 

3NBT132 

0.99 

106 

65 

0.22 

0.89 

-1.24 

0.78 

-1.42 

0.00 

0.54 

1.30 

3NBT133 

2.00 

109 

68 

0.22 

1.13 

1.30 

1.27 

1.63 

0.00 

0.36 

0.69 

3NBT134 

1.17 

111 

76 

0.22 

1.01 

0.14 

0.97 

-0.14 

0.00 

0.39 

0.99 

3NBT14 

1.68 

122 

66 

0.20 

0.98 

-0.21 

0.92 

-0.57 

0.00 

0.47 

1.08 

3NBT15 

0.30 

115 

92 

0.26 

1.06 

0.47 

1.14 

0.53 

0.00 

0.35 

0.92 

3NBT16 

0.70 

116 

85 

0.23 

0.90 

-0.94 

0.82 

-0.92 

0.00 

0.44 

1.19 

3NBT17 

1.06 

108 

70 

0.22 

1.04 

0.50 

1.02 

0.17 

0.00 

0.38 

0.92 

3NBT18 

0.46 

110 

77 

0.23 

0.95 

-0.49 

0.86 

-0.72 

0.00 

0.45 

1.12 

3NBT19 

0.02 

107 

89 

0.29 

0.96 

-0.16 

0.74 

-0.66 

0.00 

0.45 

1.07 

3NBT21 

-0.50 

116 

103 

0.31 

0.98 

-0.05 

0.78 

-0.43 

0.00 

0.32 

1.04 

3NBT210 

0.10 

120 

99 

0.26 

0.96 

-0.19 

1.22 

0.76 

0.00 

0.34 

1.00 

3NBT211 

1.87 

125 

63 

0.21 

1.19 

2.11 

1.17 

1.34 

0.00 

0.36 

0.58 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

3NBT212 

0.68 

116 

82 

0.22 

0.99 

-0.08 

0.89 

-0.48 

0.00 

0.41 

1.05 

3NBT213 

1.38 

123 

81 

0.21 

0.98 

-0.20 

0.91 

-0.55 

0.00 

0.45 

1.07 

3NBT214 

0.78 

111 

85 

0.25 

1.00 

0.06 

0.97 

-0.03 

0.00 

0.39 

1.01 

3NBT215 

1.24 

106 

60 

0.22 

1.02 

0.29 

1.29 

1.86 

0.00 

0.41 

0.83 

3NBT216 

2.05 

107 

66 

0.23 

1.06 

0.61 

1.14 

0.91 

0.00 

0.41 

0.84 

3NBT217 

1.22 

111 

75 

0.22 

0.92 

-0.86 

0.86 

-0.82 

0.00 

0.46 

1.19 

3NBT218 

1.84 

121 

62 

0.21 

0.88 

-1.51 

0.84 

-1.33 

0.00 

0.55 

1.32 

3NBT219 

1.62 

114 

67 

0.22 

1.09 

0.99 

1.11 

0.76 

0.00 

0.42 

0.78 

3NBT22 

1.31 

116 

72 

0.21 

1.13 

1.50 

1.44 

2.93 

0.00 

0.26 

0.58 

3NBT220 

0.82 

107 

74 

0.23 

1.03 

0.33 

1.09 

0.55 

0.00 

0.37 

0.92 

3NBT221 

1.17 

108 

61 

0.22 

0.91 

-1.04 

0.90 

-0.76 

0.00 

0.50 

1.23 

3NBT222 

0.34 

107 

85 

0.27 

0.90 

-0.70 

1.05 

0.27 

0.00 

0.49 

1.11 

3NBT223 

0.61 

114 

86 

0.24 

0.99 

-0.01 

0.86 

-0.58 

0.00 

0.41 

1.04 

3NBT224 

-1.90 

119 

115 

0.52 

0.88 

-0.13 

0.33 

-0.95 

0.00 

0.29 

1.10 

3NBT225 

0.57 

124 

91 

0.23 

1.14 

1.22 

1.14 

0.70 

0.00 

0.33 

0.79 

3NBT226 

1.15 

116 

72 

0.21 

0.97 

-0.35 

0.93 

-0.44 

0.00 

0.45 

1.09 

3NBT227 

-1.67 

216 

207 

0.35 

1.01 

0.12 

0.58 

-0.66 

0.00 

0.24 

1.02 

3NBT228 

2.01 

123 

66 

0.20 

1.13 

1.65 

1.25 

2.00 

0.00 

0.32 

0.57 

3NBT229 

0.24 

111 

93 

0.28 

0.90 

-0.54 

0.77 

-0.60 

0.00 

0.41 

1.11 

3NBT23 

0.79 

106 

69 

0.23 

0.94 

-0.63 

1.14 

0.80 

0.00 

0.46 

1.07 

3NBT230 

0.76 

106 

87 

0.28 

0.98 

-0.06 

0.87 

-0.33 

0.00 

0.39 

1.03 

3NBT231 

2.04 

110 

57 

0.21 

1.01 

0.13 

1.05 

0.43 

0.00 

0.42 

0.95 

3NBT232 

1.02 

121 

81 

0.21 

0.87 

-1.59 

0.74 

-1.52 

0.01 

0.51 

1.34 

3NBT233 

0.49 

238 

184 

0.17 

0.97 

-0.32 

0.84 

-0.91 

0.00 

0.41 

1.07 

3NBT24 

-0.21 

114 

98 

0.29 

0.92 

-0.39 

0.96 

0.03 

0.00 

0.38 

1.05 

3NBT25 

-1.54 

234 

223 

0.32 

0.92 

-0.22 

0.69 

-0.58 

0.00 

0.26 

1.06 

3NBT26 

0.43 

116 

90 

0.24 

1.05 

0.48 

1.98 

3.37 

0.00 

0.22 

0.81 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

3NBT27 

-0.04 

107 

88 

0.27 

1.10 

0.63 

1.27 

0.97 

0.00 

0.25 

0.86 

3NBT28 

-0.99 

108 

96 

0.32 

1.01 

0.10 

1.77 

1.60 

0.00 

0.20 

0.92 

3NBT29 

-0.35 

107 

93 

0.32 

0.95 

-0.21 

0.73 

-0.52 

0.00 

0.42 

1.08 

3NBT31 

-1.59 

114 

109 

0.47 

1.01 

0.17 

0.65 

-0.33 

0.00 

0.20 

1.01 

3NBT310 

0.86 

119 

85 

0.22 

1.17 

1.59 

1.10 

0.56 

0.00 

0.29 

0.72 

3NBT311 

1.84 

124 

63 

0.21 

1.10 

1.12 

1.20 

1.53 

0.00 

0.40 

0.73 

3NBT312 

1.45 

114 

64 

0.21 

1.11 

1.40 

1.09 

0.71 

0.00 

0.35 

0.70 

3NBT313 

1.05 

123 

88 

0.22 

0.95 

-0.46 

1.13 

0.72 

0.00 

0.42 

1.03 

3NBT314 

1.39 

111 

74 

0.23 

0.91 

-0.87 

0.85 

-0.80 

0.00 

0.49 

1.18 

3NBT315 

0.69 

106 

71 

0.23 

0.97 

-0.27 

0.88 

-0.59 

0.00 

0.46 

1.08 

3NBT316 

2.69 

106 

53 

0.22 

1.28 

2.97 

1.31 

2.18 

0.00 

0.28 

0.29 

3NBT317 

0.73 

109 

83 

0.24 

0.96 

-0.26 

0.82 

-0.72 

0.00 

0.40 

1.09 

3NBT318 

1.71 

119 

64 

0.21 

0.83 

-2.30 

0.74 

-2.13 

0.01 

0.59 

1.50 

3NBT319 

0.02 

244 

198 

0.18 

0.89 

-1.19 

0.81 

-0.90 

0.00 

0.44 

1.14 

3NBT32 

0.26 

111 

89 

0.26 

0.87 

-0.93 

0.64 

-1.21 

0.00 

0.49 

1.20 

3NBT320 

0.48 

116 

89 

0.24 

0.82 

-1.61 

0.69 

-1.47 

0.00 

0.50 

1.29 

3NBT321 

0.25 

106 

83 

0.26 

0.97 

-0.16 

0.75 

-1.04 

0.00 

0.44 

1.09 

3NBT322 

0.20 

107 

79 

0.24 

0.84 

-1.41 

0.68 

-1.57 

0.00 

0.51 

1.30 

3NBT323 

0.82 

107 

78 

0.25 

0.83 

-1.39 

0.66 

-1.58 

0.00 

0.58 

1.29 

3NBT324 

0.72 

114 

84 

0.24 

0.83 

-1.54 

0.70 

-1.51 

0.00 

0.53 

1.29 

3NBT325 

1.06 

119 

81 

0.22 

1.01 

0.09 

0.92 

-0.39 

0.00 

0.41 

1.01 

3NBT326 

0.20 

122 

96 

0.24 

0.84 

-1.27 

0.60 

-1.61 

0.00 

0.53 

1.25 

3NBT327 

0.56 

114 

83 

0.23 

0.93 

-0.63 

0.80 

-0.92 

0.00 

0.45 

1.16 

3NBT328 

0.14 

122 

103 

0.27 

0.87 

-0.76 

0.62 

-1.22 

0.00 

0.46 

1.16 

3NBT329 

0.47 

110 

89 

0.26 

0.95 

-0.29 

0.78 

-0.66 

0.00 

0.41 

1.08 

3NBT33 

0.18 

106 

80 

0.25 

0.91 

-0.68 

0.74 

-1.02 

0.00 

0.47 

1.16 

3NBT330 

0.98 

106 

84 

0.27 

0.96 

-0.22 

0.80 

-0.66 

0.00 

0.44 

1.08 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

3NBT331 

0.41 

109 

88 

0.26 

0.86 

-0.94 

0.65 

-1.33 

0.01 

0.46 

1.20 

3NBT332 

1.58 

119 

67 

0.21 

0.81 

-2.59 

0.71 

-2.25 

0.01 

0.59 

1.55 

3NBT333 

-0.10 

110 

93 

0.29 

0.80 

-1.23 

0.53 

-1.37 

0.00 

0.50 

1.23 

3NBT34 

0.59 

116 

87 

0.23 

0.83 

-1.55 

0.73 

-1.37 

0.00 

0.49 

1.28 

3NBT35 

0.31 

106 

82 

0.25 

0.88 

-0.85 

0.68 

-1.44 

0.00 

0.51 

1.20 

3NBT36 

0.08 

122 

98 

0.25 

0.91 

-0.64 

0.70 

-1.04 

0.00 

0.47 

1.14 

3NBT37 

0.86 

114 

77 

0.22 

0.88 

-1.31 

0.75 

-1.42 

0.00 

0.51 

1.30 

3NBT38 

-0.35 

240 

215 

0.22 

0.98 

-0.10 

0.76 

-0.73 

0.00 

0.32 

1.04 

3NBT39 

1.65 

122 

74 

0.21 

1.16 

1.97 

1.15 

1.08 

0.00 

0.31 

0.60 

3NF21 

-0.06 

117 

89 

0.24 

0.88 

-0.93 

0.76 

-0.98 

0.00 

0.50 

1.17 

3NF210 

-1.12 

109 

101 

0.39 

0.87 

-0.40 

0.41 

-0.94 

0.00 

0.39 

1.13 

3NF211 

-0.72 

117 

106 

0.33 

0.84 

-0.62 

0.50 

-1.14 

0.00 

0.40 

1.14 

3NF212 

-0.48 

123 

109 

0.30 

0.71 

-1.55 

0.37 

-1.90 

0.00 

0.52 

1.26 

3NF213 

-1.72 

129 

123 

0.43 

1.03 

0.19 

0.85 

0.00 

0.00 

0.20 

0.99 

3NF214 

-0.89 

117 

106 

0.33 

1.00 

0.07 

1.23 

0.60 

0.00 

0.23 

0.99 

3NF215 

-1.17 

130 

123 

0.40 

0.93 

-0.12 

0.49 

-0.82 

0.00 

0.32 

1.08 

3NF216 

-0.14 

113 

99 

0.31 

0.85 

-0.75 

0.66 

-0.75 

0.00 

0.42 

1.14 

3NF217 

-1.40 

108 

100 

0.38 

1.00 

0.11 

1.29 

0.64 

0.00 

0.21 

0.96 

3NF218 

0.00 

109 

109 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

3NF219 

-1.17 

111 

105 

0.43 

0.85 

-0.32 

1.02 

0.25 

0.00 

0.30 

1.07 

3NF22 

-0.91 

238 

219 

0.25 

0.84 

-0.84 

0.50 

-1.56 

0.00 

0.38 

1.13 

3NF220 

-0.95 

129 

118 

0.33 

0.97 

-0.06 

0.81 

-0.24 

0.00 

0.28 

1.03 

3NF221 

-1.00 

118 

109 

0.37 

0.96 

-0.04 

0.77 

-0.20 

0.00 

0.30 

1.04 

3NF222 

-1.33 

220 

204 

0.27 

0.91 

-0.42 

0.61 

-0.88 

0.00 

0.33 

1.09 

3NF223 

-0.21 

118 

101 

0.28 

1.00 

0.07 

1.00 

0.11 

0.00 

0.28 

1.01 

3NF224 

-2.29 

115 

112 

0.60 

0.88 

-0.07 

0.32 

-0.78 

0.00 

0.32 

1.09 

3NF225 

-1.49 

110 

102 

0.38 

0.89 

-0.31 

0.47 

-1.02 

0.00 

0.35 

1.11 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

3NF226 

-1.91 

107 

103 

0.53 

0.84 

-0.26 

0.22 

-1.02 

0.00 

0.34 

1.14 

3NF227 

-0.32 

116 

101 

0.29 

0.95 

-0.20 

0.79 

-0.45 

0.00 

0.34 

1.05 

3NF228 

-0.99 

120 

111 

0.36 

0.90 

-0.31 

0.65 

-0.58 

0.00 

0.33 

1.08 

3NF229 

-0.16 

126 

105 

0.26 

0.99 

0.01 

0.93 

-0.11 

0.00 

0.37 

1.02 

3NF23 

-0.19 

116 

97 

0.27 

0.89 

-0.70 

0.60 

-1.27 

0.00 

0.43 

1.17 

3NF230 

0.11 

125 

106 

0.27 

0.88 

-0.67 

0.95 

-0.06 

0.00 

0.42 

1.11 

3NF231 

-0.30 

111 

99 

0.32 

0.94 

-0.20 

0.78 

-0.35 

0.00 

0.34 

1.06 

3NF232 

0.05 

106 

82 

0.25 

1.08 

0.67 

1.42 

1.42 

0.00 

0.28 

0.81 

3NF233 

-0.75 

108 

102 

0.44 

0.89 

-0.23 

0.45 

-0.78 

0.00 

0.34 

1.10 

3NF234 

-0.58 

111 

101 

0.35 

0.93 

-0.22 

0.61 

-0.79 

0.01 

0.34 

1.08 

3NF235 

0.69 

121 

88 

0.22 

1.16 

1.60 

1.49 

1.97 

0.01 

0.22 

0.60 

3NF236 

0.09 

115 

95 

0.27 

1.05 

0.39 

0.93 

-0.08 

0.00 

0.35 

0.96 

3NF237 

-0.67 

235 

213 

0.23 

0.98 

-0.07 

0.75 

-0.69 

0.01 

0.28 

1.04 

3NF238 

2.94 

116 

35 

0.22 

1.42 

3.67 

1.95 

4.69 

0.00 

0.00 

0.09 

3NF239 

2.96 

107 

30 

0.23 

1.23 

1.96 

1.65 

2.83 

0.00 

0.14 

0.51 

3NF24 

-1.81 

110 

104 

0.43 

0.88 

-0.25 

0.36 

-1.16 

0.00 

0.34 

1.12 

3NF240 

-0.68 

107 

96 

0.35 

0.73 

-1.26 

0.36 

-1.46 

0.00 

0.50 

1.25 

3NF241 

0.63 

116 

87 

0.24 

1.02 

0.20 

1.00 

0.08 

0.00 

0.38 

0.98 

3NF242 

1.62 

120 

69 

0.21 

0.98 

-0.17 

0.94 

-0.42 

0.00 

0.45 

1.06 

3NF243 

1.53 

125 

71 

0.21 

1.11 

1.29 

1.10 

0.74 

0.00 

0.40 

0.76 

3NF244 

1.20 

116 

71 

0.21 

1.07 

0.81 

1.02 

0.21 

0.00 

0.38 

0.85 

3NF245 

0.75 

123 

94 

0.23 

1.04 

0.33 

1.06 

0.33 

0.00 

0.35 

0.94 

3NF246 

0.53 

111 

89 

0.26 

1.11 

0.77 

1.06 

0.29 

0.00 

0.30 

0.89 

3NF247 

0.11 

106 

81 

0.25 

0.92 

-0.62 

0.77 

-0.86 

0.00 

0.46 

1.15 

3NF248 

1.12 

244 

155 

0.15 

1.12 

1.87 

1.14 

1.22 

0.00 

0.36 

0.76 

3NF249 

2.19 

106 

63 

0.23 

1.13 

1.36 

1.11 

0.75 

0.00 

0.38 

0.72 

3NF25 

-0.56 

110 

100 

0.35 

0.94 

-0.15 

0.98 

0.12 

0.01 

0.31 

1.05 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

3NF250 

1.28 

121 

75 

0.21 

1.05 

0.61 

0.97 

-0.12 

0.01 

0.40 

0.91 

3NF251 

0.50 

114 

88 

0.25 

1.09 

0.69 

1.15 

0.60 

0.00 

0.35 

0.88 

3NF252 

1.40 

116 

70 

0.21 

0.95 

-0.55 

0.91 

-0.64 

0.00 

0.44 

1.14 

3NF253 

0.55 

107 

79 

0.24 

1.10 

0.84 

1.10 

0.54 

0.00 

0.31 

0.85 

3NF254 

0.78 

108 

69 

0.22 

1.19 

1.98 

1.20 

1.24 

0.00 

0.28 

0.56 

3NF255 

1.30 

107 

70 

0.24 

0.98 

-0.17 

0.95 

-0.24 

0.00 

0.53 

1.04 

3NF256 

0.67 

114 

85 

0.24 

0.95 

-0.39 

0.83 

-0.74 

0.00 

0.44 

1.10 

3NF257 

1.06 

119 

81 

0.22 

1.10 

1.03 

1.13 

0.74 

0.00 

0.34 

0.80 

3NF258 

0.82 

124 

86 

0.22 

1.01 

0.18 

0.98 

-0.06 

0.00 

0.44 

0.98 

3NF259 

0.88 

116 

78 

0.22 

1.02 

0.21 

0.92 

-0.41 

0.00 

0.40 

1.00 

3NF26 

-1.10 

123 

116 

0.40 

0.91 

-0.18 

0.57 

-0.60 

0.00 

0.33 

1.08 

3NF260 

1.23 

111 

77 

0.23 

1.13 

1.19 

1.16 

0.80 

0.00 

0.33 

0.75 

3NF261 

-1.56 

106 

99 

0.41 

0.86 

-0.38 

0.39 

-1.00 

0.00 

0.38 

1.13 

3NF262 

0.98 

106 

84 

0.27 

1.01 

0.10 

0.93 

-0.16 

0.00 

0.40 

1.01 

3NF263 

0.35 

233 

184 

0.17 

1.06 

0.71 

1.00 

0.05 

0.00 

0.32 

0.92 

3NF264 

2.18 

110 

54 

0.21 

1.13 

1.56 

1.16 

1.36 

0.00 

0.33 

0.62 

3NF265 

1.42 

120 

71 

0.21 

1.01 

0.15 

0.96 

-0.25 

0.01 

0.44 

1.01 

3NF266 

-0.30 

114 

99 

0.30 

1.03 

0.20 

1.14 

0.45 

0.00 

0.30 

0.95 

3NF267 

1.31 

116 

72 

0.21 

0.89 

-1.39 

0.81 

-1.46 

0.00 

0.50 

1.33 

3NF268 

1.24 

106 

65 

0.22 

0.95 

-0.59 

0.94 

-0.41 

0.00 

0.47 

1.13 

3NF269 

0.98 

108 

65 

0.22 

1.19 

2.05 

1.24 

1.66 

0.00 

0.29 

0.50 

3NF27 

-0.94 

107 

98 

0.38 

0.85 

-0.55 

0.54 

-0.72 

0.00 

0.40 

1.13 

3NF270 

0.61 

114 

86 

0.24 

1.08 

0.66 

1.19 

0.85 

0.00 

0.32 

0.85 

3NF271 

0.11 

119 

98 

0.26 

0.83 

-1.13 

1.82 

2.27 

0.00 

0.42 

1.13 

3NF272 

0.35 

124 

95 

0.24 

0.92 

-0.64 

0.99 

0.04 

0.00 

0.46 

1.10 

3NF273 

0.86 

114 

77 

0.22 

1.29 

2.90 

1.45 

2.22 

0.00 

0.15 

0.33 

3NF274 

0.86 

122 

91 

0.23 

1.11 

0.98 

1.18 

0.85 

0.00 

0.30 

0.82 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

3NF275 

0.66 

111 

87 

0.25 

1.09 

0.72 

0.94 

-0.13 

0.00 

0.33 

0.92 

3NF276 

0.63 

106 

72 

0.23 

1.09 

0.96 

0.98 

-0.05 

0.00 

0.37 

0.86 

3NF277 

1.61 

106 

74 

0.24 

1.08 

0.70 

1.24 

1.21 

0.00 

0.37 

0.82 

3NF278 

0.73 

109 

83 

0.24 

0.80 

-1.73 

0.65 

-1.65 

0.00 

0.53 

1.33 

3NF279 

0.28 

119 

94 

0.24 

0.98 

-0.10 

0.77 

-0.77 

0.01 

0.37 

1.07 

3NF28 

-1.08 

111 

103 

0.39 

0.95 

-0.08 

0.63 

-0.45 

0.00 

0.31 

1.05 

3NF280 

1.40 

116 

70 

0.21 

0.96 

-0.50 

0.90 

-0.78 

0.00 

0.44 

1.15 

3NF29 

-1.15 

106 

98 

0.39 

0.98 

0.03 

1.12 

0.39 

0.00 

0.26 

1.00 

3NF31 

1.66 

107 

50 

0.22 

0.80 

-2.46 

0.76 

-2.13 

0.00 

0.61 

1.54 

3NF310 

1.13 

107 

73 

0.24 

1.07 

0.60 

1.00 

0.07 

0.00 

0.48 

0.91 

3NF311 

1.98 

114 

58 

0.21 

0.84 

-2.02 

0.89 

-0.93 

0.00 

0.57 

1.38 

3NF312 

3.29 

119 

32 

0.23 

0.83 

-1.47 

0.67 

-1.69 

0.00 

0.59 

1.28 

3NF313 

0.94 

122 

82 

0.22 

0.87 

-1.29 

0.75 

-1.45 

0.00 

0.55 

1.26 

3NF314 

1.14 

114 

71 

0.21 

1.16 

1.83 

1.16 

1.04 

0.00 

0.29 

0.60 

3NF315 

2.19 

122 

61 

0.20 

1.33 

3.88 

1.37 

2.85 

0.00 

0.19 

0.10 

3NF316 

1.36 

110 

74 

0.23 

0.85 

-1.50 

0.76 

-1.30 

0.00 

0.54 

1.31 

3NF317 

1.44 

106 

56 

0.22 

0.90 

-1.15 

0.81 

-1.41 

0.00 

0.55 

1.29 

3NF318 

0.51 

106 

90 

0.30 

0.93 

-0.32 

0.61 

-1.12 

0.00 

0.44 

1.12 

3NF319 

1.01 

109 

78 

0.23 

0.90 

-1.00 

0.80 

-1.01 

0.00 

0.47 

1.22 

3NF32 

1.23 

119 

75 

0.21 

1.15 

1.76 

1.10 

0.65 

0.01 

0.32 

0.65 

3NF320 

1.69 

216 

126 

0.16 

0.80 

-3.18 

0.77 

-2.17 

0.00 

0.62 

1.42 

3NF33 

1.98 

226 

113 

0.15 

1.42 

6.32 

1.56 

5.47 

0.00 

0.14 

-0.17 

3NF34 

1.25 

239 

164 

0.15 

0.93 

-0.98 

0.80 

-1.59 

0.00 

0.48 

1.17 

3NF35 

1.79 

222 

114 

0.15 

1.28 

4.64 

1.34 

3.83 

0.00 

0.18 

0.14 

3NF36 

2.00 

215 

105 

0.15 

0.84 

-2.72 

0.87 

-1.38 

0.00 

0.57 

1.38 

3NF37 

2.46 

110 

51 

0.22 

0.86 

-1.69 

0.92 

-0.56 

0.00 

0.56 

1.31 

3NF38 

3.69 

106 

17 

0.29 

1.42 

2.21 

2.90 

3.75 

0.00 

-0.02 

0.44 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

3NF39 

2.29 

106 

61 

0.22 

0.96 

-0.39 

0.95 

-0.30 

0.00 

0.49 

1.09 

30A11 

-1.81 

110 

104 

0.43 

1.05 

0.27 

1.36 

0.72 

0.00 

0.13 

0.94 

3OA110 

0.18 

107 

87 

0.28 

0.91 

-0.55 

0.81 

-0.51 

0.00 

0.48 

1.12 

30A111 

-0.50 

116 

103 

0.31 

0.78 

-1.06 

0.42 

-1.61 

0.00 

0.47 

1.21 

30A112 

-0.54 

120 

107 

0.31 

0.97 

-0.08 

0.83 

-0.28 

0.00 

0.31 

1.03 

30A113 

0.44 

126 

95 

0.23 

0.84 

-1.46 

0.64 

-1.70 

0.00 

0.55 

1.28 

30A114 

0.58 

116 

84 

0.23 

0.91 

-0.86 

0.80 

-0.93 

0.00 

0.46 

1.18 

30A115 

-0.59 

125 

114 

0.33 

0.81 

-0.78 

0.40 

-1.47 

0.00 

0.46 

1.17 

30A116 

0.08 

111 

95 

0.29 

0.96 

-0.17 

0.97 

0.04 

0.00 

0.34 

1.02 

30A117 

-1.00 

220 

199 

0.24 

1.04 

0.29 

0.97 

0.05 

0.00 

0.26 

0.96 

30A118 

-0.53 

106 

90 

0.29 

0.93 

-0.33 

0.98 

0.07 

0.00 

0.36 

1.04 

30A119 

0.55 

108 

91 

0.29 

1.06 

0.39 

0.83 

-0.39 

0.00 

0.35 

0.99 

30A12 

-1.00 

111 

104 

0.40 

1.01 

0.13 

0.70 

-0.38 

0.00 

0.24 

1.02 

3OA120 

0.64 

121 

89 

0.22 

0.83 

-1.76 

0.70 

-1.40 

0.01 

0.50 

1.33 

30A13 

-1.10 

115 

107 

0.39 

0.79 

-0.71 

0.32 

-1.25 

0.00 

0.42 

1.18 

30A14 

-1.07 

116 

108 

0.38 

0.86 

-0.40 

0.47 

-1.15 

0.00 

0.36 

1.12 

30A15 

-1.50 

107 

101 

0.44 

1.06 

0.27 

1.63 

1.06 

0.00 

0.14 

0.93 

30A16 

0.63 

235 

177 

0.16 

0.95 

-0.64 

0.89 

-0.64 

0.01 

0.40 

1.09 

30A17 

0.76 

110 

71 

0.22 

1.02 

0.21 

0.94 

-0.33 

0.00 

0.42 

0.99 

30A18 

0.41 

107 

84 

0.27 

0.95 

-0.32 

1.45 

1.44 

0.00 

0.43 

0.97 

30A19 

-1.07 

115 

107 

0.38 

1.13 

0.52 

1.72 

1.22 

0.00 

0.09 

0.87 

30A41 

-0.45 

120 

106 

0.30 

0.80 

-1.01 

0.52 

-1.29 

0.00 

0.45 

1.19 

3OA410 

0.71 

125 

89 

0.22 

0.93 

-0.68 

0.79 

-1.06 

0.00 

0.50 

1.16 

30A411 

0.88 

116 

78 

0.22 

0.82 

-2.02 

0.73 

-1.59 

0.00 

0.54 

1.40 

30A412 

0.40 

123 

100 

0.25 

0.92 

-0.50 

0.75 

-0.90 

0.00 

0.43 

1.11 

30A413 

0.53 

111 

89 

0.26 

0.93 

-0.49 

0.82 

-0.54 

0.00 

0.42 

1.10 

30A414 

-0.15 

106 

85 

0.26 

0.66 

-2.65 

0.43 

-2.24 

0.00 

0.63 

1.44 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30A415 

1.25 

106 

80 

0.25 

0.98 

-0.11 

1.32 

1.28 

0.00 

0.40 

0.98 

30A416 

1.49 

110 

69 

0.22 

1.06 

0.67 

1.10 

0.69 

0.00 

0.35 

0.83 

30A417 

1.15 

121 

78 

0.21 

1.08 

0.97 

1.12 

0.73 

0.01 

0.35 

0.78 

30A418 

1.27 

114 

74 

0.22 

0.93 

-0.65 

0.84 

-0.88 

0.00 

0.51 

1.16 

30A419 

0.64 

116 

86 

0.23 

0.81 

-1.84 

0.67 

-1.75 

0.00 

0.52 

1.35 

30A42 

-0.37 

107 

92 

0.30 

0.80 

-1.02 

0.58 

-1.32 

0.00 

0.51 

1.19 

3OA420 

-0.11 

108 

85 

0.25 

0.86 

-1.08 

0.64 

-1.47 

0.00 

0.48 

1.24 

30A43 

0.48 

107 

83 

0.27 

0.85 

-1.11 

0.63 

-1.44 

0.00 

0.55 

1.24 

30A44 

-0.72 

233 

211 

0.24 

0.84 

-0.98 

0.65 

-1.05 

0.00 

0.38 

1.13 

30A45 

-0.29 

114 

99 

0.30 

0.92 

-0.39 

0.88 

-0.20 

0.00 

0.36 

1.07 

30A46 

-0.26 

119 

103 

0.29 

0.91 

-0.44 

0.68 

-0.82 

0.00 

0.40 

1.11 

30A47 

-0.26 

238 

206 

0.20 

1.03 

0.30 

1.24 

0.94 

0.00 

0.29 

0.97 

30A48 

0.06 

124 

100 

0.25 

0.87 

-0.92 

0.69 

-1.07 

0.00 

0.48 

1.17 

30A49 

1.59 

116 

62 

0.21 

0.97 

-0.33 

0.93 

-0.54 

0.00 

0.47 

1.10 

30A51 

-1.48 

123 

118 

0.47 

0.91 

-0.12 

0.32 

-1.08 

0.00 

0.33 

1.10 

3OA510 

3.22 

111 

36 

0.23 

1.54 

4.40 

2.25 

5.23 

0.00 

0.02 

-0.13 

30A511 

-1.14 

106 

96 

0.35 

0.81 

-0.73 

0.42 

-1.23 

0.00 

0.44 

1.17 

30A512 

-0.54 

106 

99 

0.41 

0.94 

-0.08 

0.44 

-0.89 

0.00 

0.34 

1.09 

30A513 

1.60 

109 

66 

0.22 

1.01 

0.16 

0.94 

-0.40 

0.00 

0.42 

1.01 

30A514 

0.59 

120 

89 

0.23 

1.03 

0.37 

1.11 

0.53 

0.01 

0.33 

0.91 

30A515 

-0.21 

114 

98 

0.29 

0.98 

-0.03 

0.72 

-0.63 

0.00 

0.38 

1.05 

30A516 

0.48 

116 

89 

0.24 

0.86 

-1.18 

0.72 

-1.30 

0.00 

0.47 

1.23 

30A517 

-0.03 

106 

87 

0.27 

0.96 

-0.18 

0.89 

-0.29 

0.00 

0.40 

1.05 

30A518 

0.26 

107 

78 

0.24 

0.85 

-1.35 

0.87 

-0.58 

0.00 

0.49 

1.24 

30A519 

1.13 

107 

73 

0.24 

1.00 

0.08 

1.01 

0.13 

0.00 

0.50 

1.00 

30A52 

-2.15 

114 

111 

0.59 

0.86 

-0.11 

0.21 

-1.10 

0.00 

0.30 

1.11 

3OA520 

0.31 

119 

95 

0.25 

0.87 

-0.94 

0.68 

-1.22 

0.00 

0.47 

1.19 
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Appendix  D:  Item  Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30A53 

0.52 

124 

92 

0.23 

0.86 

-1.27 

0.69 

-1.44 

0.00 

0.53 

1.25 

30A54 

0.40 

114 

86 

0.24 

0.80 

-1.86 

0.61 

-1.79 

0.00 

0.54 

1.36 

30A55 

-0.94 

122 

114 

0.38 

0.81 

-0.59 

0.42 

-1.08 

0.00 

0.41 

1.14 

30A56 

-1.01 

244 

223 

0.24 

0.93 

-0.38 

0.57 

-1.26 

0.00 

0.34 

1.09 

30A57 

-0.01 

111 

96 

0.30 

0.95 

-0.21 

0.66 

-0.82 

0.00 

0.38 

1.08 

30A58 

0.05 

106 

82 

0.25 

0.90 

-0.76 

0.75 

-0.91 

0.00 

0.47 

1.16 

30A59 

0.91 

106 

85 

0.27 

0.92 

-0.49 

0.72 

-0.97 

0.00 

0.46 

1.13 

30A61 

1.32 

109 

72 

0.22 

1.09 

0.95 

1.03 

0.23 

0.00 

0.34 

0.83 

3OA610 

1.45 

119 

70 

0.21 

0.77 

-3.13 

0.69 

-2.35 

0.01 

0.61 

1.63 

30A611 

1.72 

110 

62 

0.22 

0.84 

-1.84 

0.77 

-1.61 

0.00 

0.59 

1.38 

30A613 

1.35 

116 

71 

0.21 

0.96 

-0.42 

0.91 

-0.63 

0.00 

0.43 

1.12 

30A614 

-0.19 

106 

89 

0.29 

0.79 

-1.22 

0.58 

-1.49 

0.00 

0.54 

1.22 

30A615 

0.56 

239 

190 

0.17 

0.87 

-1.37 

0.70 

-1.70 

0.00 

0.48 

1.19 

30A616 

1.13 

107 

61 

0.22 

0.90 

-1.23 

0.86 

-1.05 

0.00 

0.52 

1.28 

30A617 

1.00 

107 

75 

0.25 

0.72 

-2.56 

0.58 

-2.31 

0.00 

0.65 

1.47 

30A618 

1.71 

114 

64 

0.21 

1.13 

1.54 

1.18 

1.37 

0.00 

0.35 

0.63 

30A619 

1.18 

118 

78 

0.22 

1.17 

1.73 

1.10 

0.61 

0.00 

0.31 

0.68 

30A62 

0.14 

122 

97 

0.25 

0.85 

-1.17 

0.63 

-1.42 

0.00 

0.51 

1.22 

3OA620 

1.41 

114 

65 

0.21 

0.97 

-0.37 

0.96 

-0.26 

0.00 

0.45 

1.08 

30A63 

1.34 

122 

81 

0.21 

0.98 

-0.19 

1.24 

1.40 

0.00 

0.40 

0.96 

30A64 

0.67 

110 

86 

0.25 

0.70 

-2.44 

0.50 

-2.09 

0.00 

0.60 

1.41 

30A65 

1.29 

106 

59 

0.22 

0.90 

-1.14 

0.92 

-0.55 

0.00 

0.53 

1.23 

30A66 

0.42 

106 

91 

0.30 

0.90 

-0.52 

0.60 

-1.09 

0.00 

0.44 

1.14 

30A67 

1.84 

109 

61 

0.21 

1.12 

1.44 

1.22 

1.64 

0.00 

0.32 

0.61 

30A68 

0.34 

119 

93 

0.24 

1.07 

0.65 

1.22 

0.84 

0.01 

0.27 

0.86 

30A69 

1.57 

110 

65 

0.22 

0.83 

-1.92 

0.81 

-1.22 

0.00 

0.58 

1.37 

30A81 

1.61 

116 

65 

0.21 

0.94 

-0.74 

0.91 

-0.74 

0.00 

0.46 

1.18 

easyCBM  CCSS  Third  Grade  Math  Measure  Development 


225 

Appendix  D:  Item  Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

3OA810 

0.84 

106 

73 

0.23 

1.04 

0.43 

0.99 

-0.02 

0.00 

0.38 

0.94 

30A811 

1.94 

111 

46 

0.22 

1.07 

0.82 

1.18 

1.32 

0.00 

0.40 

0.79 

30A812 

1.16 

108 

73 

0.24 

0.93 

-0.61 

0.85 

-0.77 

0.00 

0.55 

1.14 

30A813 

0.46 

116 

90 

0.24 

1.13 

1.05 

1.07 

0.38 

0.00 

0.29 

0.83 

30A814 

1.44 

121 

74 

0.21 

1.11 

1.34 

1.09 

0.67 

0.00 

0.35 

0.73 

30A815 

0.33 

127 

98 

0.23 

0.86 

-1.15 

1.03 

0.21 

0.00 

0.48 

1.15 

30A816 

0.72 

117 

82 

0.22 

0.94 

-0.60 

0.87 

-0.64 

0.00 

0.44 

1.13 

30A817 

2.08 

127 

66 

0.20 

1.02 

0.24 

1.00 

0.00 

0.00 

0.43 

0.96 

30A818 

1.87 

111 

64 

0.22 

0.91 

-1.00 

0.84 

-1.13 

0.00 

0.52 

1.24 

30A819 

1.39 

106 

57 

0.22 

1.09 

1.07 

1.14 

1.00 

0.00 

0.39 

0.75 

30A82 

2.68 

109 

54 

0.22 

1.14 

1.55 

1.20 

1.48 

0.00 

0.37 

0.63 

3OA820 

1.22 

111 

75 

0.22 

0.91 

-0.92 

0.81 

-1.11 

0.00 

0.47 

1.22 

30A83 

2.09 

216 

110 

0.16 

1.11 

1.65 

1.12 

1.16 

0.00 

0.43 

0.76 

30A84 

1.47 

122 

71 

0.21 

0.90 

-1.33 

0.86 

-0.97 

0.01 

0.51 

1.27 

30A85 

1.53 

116 

70 

0.22 

1.05 

0.62 

1.14 

0.91 

0.00 

0.43 

0.86 

30A86 

1.26 

116 

73 

0.21 

0.90 

-1.16 

0.81 

-1.38 

0.00 

0.49 

1.29 

30A87 

0.96 

108 

72 

0.22 

1.04 

0.42 

0.96 

-0.18 

0.00 

0.39 

0.95 

30A88 

2.57 

109 

45 

0.22 

1.16 

1.75 

1.41 

2.85 

0.00 

0.29 

0.50 

30A89 

2.32 

119 

50 

0.21 

1.23 

2.29 

1.30 

2.19 

0.00 

0.32 

0.50 
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Appendix  E:  Distractor  Statistics 


Appendix  E:  Distractor  Statistics  for  Full  CCSS  Item  Bank 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30001 

* 

-1 

4959 

99 

1.21 

0.02 

0.00 

0.01 

30001 

A 

1 

29 

83 

1.29 

0.15 

0.77 

0.67 

30001 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30001 

C 

0 

3 

9 

-0.53 

0.13 

0.30 

-0.47 

30001 

D 

0 

3 

9 

-0.41 

0.21 

0.35 

-0.43 

30002 

* 

-1 

4932 

99 

1.21 

0.02 

0.00 

0.05 

30002 

A 

1 

37 

60 

1.28 

0.18 

0.65 

0.63 

30002 

B 

0 

11 

18 

-0.23 

0.24 

0.67 

-0.28 

30002 

C 

0 

5 

8 

-0.88 

0.59 

0.49 

-0.33 

30002 

D 

0 

9 

15 

-0.42 

0.32 

0.59 

-0.31 

30003 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.03 

30003 

A 

1 

35 

58 

1.16 

0.15 

0.99 

0.38 

30003 

B 

0 

18 

30 

0.63 

0.19 

1.13 

-0.16 

30003 

C 

0 

4 

7 

-0.19 

0.17 

0.39 

-0.29 

30003 

D 

0 

3 

5 

0.06 

0.75 

0.87 

-0.19 

30004 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

30004 

A 

1 

24 

42 

1.39 

0.30 

1.13 

0.35 

30004 

B 

0 

13 

23 

0.66 

0.30 

1.23 

-0.08 

30004 

C 

0 

18 

32 

0.48 

0.20 

0.99 

-0.19 

30004 

D 

0 

2 

4 

-1.13 

1.14 

0.24 

-0.29 

30005 

* 

-1 

4952 

99 

1.21 

0.02 

0.00 

0.05 

30005 

A 

1 

21 

50 

1.19 

0.21 

0.78 

0.62 

30005 

B 

0 

12 

29 

0.07 

0.19 

0.80 

-0.28 

30005 

C 

0 

4 

10 

-0.38 

0.33 

0.47 

-0.28 

30005 

D 

0 

5 

12 

-0.35 

0.37 

0.55 

-0.31 

30006 

* 

-1 

4947 

99 

1.21 

0.02 

0.00 

0.03 

30006 

A 

1 

24 

51 

1.21 

0.22 

1.30 

0.36 

30006 

B 

0 

4 

9 

1.19 

0.09 

1.45 

0.10 

30006 

C 

0 

16 

34 

0.48 

0.22 

1.03 

-0.25 

30006 

D 

0 

3 

6 

-0.57 

0.23 

0.26 

-0.36 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30007 

* 

-1 

4697 

94 

1.17 

0.02 

0.00 

-0.12 

30007 

A 

1 

167 

56 

2.39 

0.10 

0.96 

0.49 

30007 

B 

0 

53 

18 

0.84 

0.13 

0.70 

-0.36 

30007 

C 

0 

75 

25 

1.35 

0.11 

1.14 

-0.22 

30007 

D 

0 

2 

1 

0.45 

0.50 

0.33 

-0.09 

30008 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.05 

30008 

A 

1 

24 

42 

1.14 

0.25 

1.27 

0.33 

30008 

B 

0 

11 

19 

-0.11 

0.29 

0.57 

-0.29 

30008 

C 

0 

14 

25 

1.05 

0.15 

1.52 

0.18 

30008 

D 

0 

8 

14 

-0.51 

0.58 

0.55 

-0.37 

30009 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.05 

30009 

A 

1 

6 

11 

1.92 

0.96 

1.28 

0.35 

30009 

B 

0 

24 

44 

0.46 

0.18 

0.92 

-0.08 

30009 

C 

0 

13 

24 

0.84 

0.38 

2.44 

0.11 

30009 

D 

0 

12 

22 

-0.15 

0.27 

0.52 

-0.29 

30010 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

30010 

A 

1 

5 

9 

2.48 

0.72 

0.69 

0.48 

30010 

B 

0 

22 

39 

0.63 

0.22 

0.85 

-0.15 

30010 

C 

0 

5 

9 

0.68 

0.44 

0.71 

-0.04 

30010 

D 

0 

25 

44 

0.71 

0.14 

0.72 

-0.10 

30011 

* 

-1 

4953 

99 

1.21 

0.02 

0.00 

0.04 

30011 

A 

1 

33 

80 

0.91 

0.14 

0.83 

0.52 

30011 

B 

0 

3 

7 

-0.33 

0.42 

0.56 

-0.28 

30011 

C 

0 

1 

2 

-0.95 

0.00 

0.26 

-0.26 

30011 

D 

0 

4 

10 

-0.25 

0.69 

0.85 

-0.31 

30012 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.04 

30012 

A 

1 

37 

64 

1.12 

0.17 

1.08 

0.39 

30012 

B 

0 

11 

19 

0.41 

0.31 

1.26 

-0.11 

30012 

C 

0 

4 

7 

0.18 

0.58 

0.94 

-0.11 

30012 

D 

0 

6 

10 

-0.84 

1.04 

0.75 

-0.38 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30013 

* 

-1 

4712 

94 

1.16 

0.02 

0.00 

-0.15 

30013 

A 

1 

266 

94 

2.12 

0.08 

1.11 

0.28 

30013 

B 

0 

6 

2 

1.10 

0.58 

2.34 

-0.10 

30013 

C 

0 

3 

1 

-0.21 

0.30 

0.25 

-0.16 

30013 

D 

0 

7 

2 

0.11 

0.29 

0.40 

-0.22 

30014 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.03 

30014 

A 

1 

45 

83 

0.95 

0.13 

1.05 

0.19 

30014 

B 

0 

4 

7 

0.95 

0.50 

1.89 

0.02 

30014 

C 

0 

1 

2 

0.12 

0.00 

0.58 

-0.13 

30014 

D 

0 

4 

7 

0.19 

0.10 

0.63 

-0.23 

30015 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.02 

30015 

A 

1 

20 

35 

1.72 

0.48 

1.49 

0.38 

30015 

B 

0 

27 

47 

0.58 

0.19 

1.31 

-0.21 

30015 

C 

0 

5 

9 

0.58 

0.30 

0.95 

-0.07 

30015 

D 

0 

5 

9 

-0.15 

0.16 

0.42 

-0.21 

30016 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.02 

30016 

A 

1 

25 

43 

1.55 

0.32 

0.98 

0.43 

30016 

B 

0 

7 

12 

0.28 

0.35 

0.78 

-0.18 

30016 

C 

0 

20 

34 

0.48 

0.16 

0.92 

-0.24 

30016 

D 

0 

6 

10 

0.37 

0.26 

0.79 

-0.14 

30017 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.03 

30017 

A 

1 

27 

47 

1.53 

0.28 

1.05 

0.45 

30017 

B 

0 

13 

22 

0.47 

0.25 

0.94 

-0.15 

30017 

C 

0 

5 

9 

0.26 

0.35 

0.69 

-0.13 

30017 

D 

0 

13 

22 

0.06 

0.40 

0.75 

-0.30 

30018 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

30018 

A 

1 

44 

77 

1.07 

0.18 

0.97 

0.34 

30018 

B 

0 

13 

23 

0.09 

0.26 

0.91 

-0.34 

30018 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30018 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30019 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.06 

30019 

A 

1 

31 

53 

1.09 

0.19 

0.85 

0.53 

30019 

B 

0 

21 

36 

0.03 

0.17 

0.80 

-0.32 

30019 

C 

0 

5 

8 

-1.07 

0.30 

0.25 

-0.43 

30019 

D 

0 

2 

3 

0.78 

0.32 

1.43 

0.04 

30020 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

30020 

A 

1 

46 

81 

1.06 

0.16 

0.96 

0.44 

30020 

B 

0 

5 

9 

-0.43 

0.48 

0.66 

-0.34 

30020 

C 

0 

5 

9 

0.02 

0.09 

0.64 

-0.22 

30020 

D 

0 

1 

2 

-0.08 

0.00 

0.57 

-0.11 

30021 

* 

-1 

4932 

99 

1.21 

0.02 

0.00 

0.06 

30021 

A 

1 

43 

69 

0.76 

0.16 

1.12 

0.32 

30021 

B 

0 

18 

29 

0.10 

0.23 

1.12 

-0.24 

30021 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30021 

D 

0 

1 

2 

-2.12 

0.00 

0.09 

-0.30 

30022 

* 

-1 

4716 

94 

1.18 

0.02 

0.00 

-0.09 

30022 

A 

1 

242 

87 

1.94 

0.08 

0.97 

0.45 

30022 

B 

0 

19 

7 

0.14 

0.22 

0.59 

-0.30 

30022 

C 

0 

12 

4 

0.00 

0.27 

0.50 

-0.25 

30022 

D 

0 

5 

2 

-0.32 

0.17 

0.26 

-0.19 

30023 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30023 

A 

1 

47 

84 

0.99 

0.20 

1.09 

0.19 

30023 

B 

0 

5 

9 

0.42 

0.40 

1.40 

-0.11 

30023 

C 

0 

2 

4 

0.00 

0.59 

0.76 

-0.13 

30023 

D 

0 

2 

4 

0.37 

0.33 

0.98 

-0.07 

30024 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.03 

30024 

A 

1 

29 

53 

1.41 

0.22 

0.86 

0.50 

30024 

B 

0 

4 

7 

0.48 

0.57 

1.18 

-0.09 

30024 

C 

0 

5 

9 

-0.05 

0.26 

0.50 

-0.25 

30024 

D 

0 

17 

31 

0.30 

0.16 

0.78 

-0.33 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30025 

* 

-1 

4930 

99 

1.21 

0.02 

0.00 

0.02 

30025 

A 

1 

20 

31 

1.92 

0.26 

0.98 

0.55 

30025 

B 

0 

10 

16 

0.34 

0.28 

0.60 

-0.22 

30025 

C 

0 

13 

20 

0.64 

0.27 

0.89 

-0.13 

30025 

D 

0 

21 

33 

0.50 

0.22 

0.73 

-0.26 

30026 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.06 

30026 

A 

1 

24 

41 

0.83 

0.23 

1.67 

0.25 

30026 

B 

0 

4 

7 

0.93 

0.29 

1.51 

0.10 

30026 

C 

0 

5 

8 

0.31 

0.48 

1.09 

-0.05 

30026 

D 

0 

26 

44 

0.16 

0.22 

1.11 

-0.27 

30027 

* 

-1 

4944 

99 

1.21 

0.02 

0.00 

0.01 

30027 

A 

1 

26 

52 

1.65 

0.25 

0.78 

0.48 

30027 

B 

0 

6 

12 

0.89 

0.48 

1.54 

-0.05 

30027 

C 

0 

5 

10 

0.85 

0.13 

0.93 

-0.06 

30027 

D 

0 

13 

26 

0.07 

0.25 

0.63 

-0.47 

30028 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.03 

30028 

A 

1 

17 

29 

1.78 

0.25 

0.75 

0.51 

30028 

B 

0 

6 

10 

0.52 

0.32 

0.74 

-0.08 

30028 

C 

0 

10 

17 

0.71 

0.38 

1.25 

-0.04 

30028 

D 

0 

25 

43 

0.26 

0.22 

0.75 

-0.39 

30029 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.05 

30029 

A 

1 

46 

84 

0.77 

0.13 

0.93 

0.36 

30029 

B 

0 

5 

9 

0.53 

0.31 

1.51 

-0.03 

30029 

C 

0 

2 

4 

-0.92 

0.28 

0.29 

-0.31 

30029 

D 

0 

2 

4 

-1.07 

0.06 

0.24 

-0.34 

30030 

* 

-1 

4930 

99 

1.21 

0.02 

0.00 

0.05 

30030 

A 

1 

48 

75 

0.87 

0.15 

1.08 

0.48 

30030 

B 

0 

4 

6 

-0.38 

0.46 

0.66 

-0.23 

30030 

C 

0 

8 

13 

-0.20 

0.26 

0.75 

-0.28 

30030 

D 

0 

4 

6 

-0.43 

0.40 

0.55 

-0.24 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30031 

* 

-1 

4928 

99 

1.21 

0.02 

0.00 

0.05 

30031 

A 

1 

43 

65 

1.05 

0.13 

0.77 

0.58 

30031 

B 

0 

12 

18 

0.18 

0.23 

0.99 

-0.19 

30031 

C 

0 

4 

6 

-0.97 

0.33 

0.27 

-0.37 

30031 

D 

0 

7 

11 

-0.58 

0.40 

0.54 

-0.38 

30032 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.04 

30032 

A 

1 

43 

80 

0.94 

0.19 

0.95 

0.34 

30032 

B 

0 

6 

11 

0.56 

0.31 

1.62 

-0.05 

30032 

C 

0 

3 

6 

-0.98 

0.10 

0.27 

-0.33 

30032 

D 

0 

2 

4 

-0.90 

0.15 

0.30 

-0.26 

30033 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.02 

30033 

A 

1 

16 

28 

1.83 

0.32 

0.95 

0.47 

30033 

B 

0 

16 

28 

0.74 

0.18 

0.89 

-0.14 

30033 

C 

0 

3 

5 

1.32 

0.34 

1.41 

0.07 

30033 

D 

0 

23 

40 

0.54 

0.20 

0.79 

-0.33 

30034 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.06 

30034 

A 

1 

10 

17 

1.48 

0.44 

1.02 

0.40 

30034 

B 

0 

18 

31 

0.37 

0.29 

1.13 

-0.05 

30034 

C 

0 

4 

7 

1.05 

0.53 

1.76 

0.14 

30034 

D 

0 

27 

46 

0.04 

0.16 

0.61 

-0.32 

30035 

* 

-1 

4946 

99 

1.21 

0.02 

0.00 

0.03 

30035 

A 

1 

25 

52 

1.21 

0.18 

1.00 

0.43 

30035 

B 

0 

8 

17 

0.50 

0.29 

1.04 

-0.13 

30035 

C 

0 

3 

6 

0.66 

0.63 

1.23 

-0.03 

30035 

D 

0 

12 

25 

0.15 

0.30 

0.80 

-0.37 

30036 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.03 

30036 

A 

1 

33 

60 

1.42 

0.15 

0.70 

0.63 

30036 

B 

0 

8 

15 

0.18 

0.39 

0.99 

-0.23 

30036 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30036 

D 

0 

14 

25 

-0.23 

0.28 

0.60 

-0.52 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30037 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.03 

30037 

A 

1 

35 

60 

1.30 

0.26 

1.28 

0.37 

30037 

B 

0 

9 

16 

0.51 

0.32 

1.20 

-0.12 

30037 

C 

0 

4 

7 

0.12 

0.54 

0.84 

-0.15 

30037 

D 

0 

10 

17 

0.09 

0.27 

0.77 

-0.26 

30038 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.05 

30038 

A 

1 

24 

41 

1.41 

0.27 

0.85 

0.44 

30038 

B 

0 

16 

28 

0.20 

0.18 

0.77 

-0.19 

30038 

C 

0 

4 

7 

0.59 

0.58 

1.32 

-0.01 

30038 

D 

0 

14 

24 

-0.14 

0.50 

0.88 

-0.30 

30039 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.05 

30039 

A 

1 

35 

61 

0.88 

0.14 

1.00 

0.41 

30039 

B 

0 

12 

21 

0.02 

0.31 

1.12 

-0.31 

30039 

C 

0 

3 

5 

0.14 

0.58 

0.97 

-0.11 

30039 

D 

0 

7 

12 

0.19 

0.26 

0.90 

-0.15 

30040 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.05 

30040 

A 

1 

25 

45 

1.12 

0.21 

0.87 

0.50 

30040 

B 

0 

8 

14 

0.14 

0.23 

0.75 

-0.18 

30040 

C 

0 

10 

18 

0.48 

0.23 

1.09 

-0.05 

30040 

D 

0 

13 

23 

-0.11 

0.18 

0.61 

-0.39 

30041 

* 

-1 

4944 

99 

1.21 

0.02 

0.00 

0.04 

30041 

A 

1 

17 

34 

1.73 

0.31 

0.60 

0.63 

30041 

B 

0 

19 

38 

0.15 

0.19 

0.80 

-0.30 

30041 

C 

0 

5 

10 

0.05 

0.47 

0.76 

-0.15 

30041 

D 

0 

9 

18 

-0.15 

0.25 

0.55 

-0.29 

30042 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

30042 

A 

1 

32 

56 

1.32 

0.18 

0.86 

0.54 

30042 

B 

0 

10 

18 

0.13 

0.22 

0.69 

-0.29 

30042 

C 

0 

9 

16 

0.43 

0.26 

1.01 

-0.15 

30042 

D 

0 

6 

11 

-0.24 

0.35 

0.52 

-0.33 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30043 

* 

-1 

4942 

99 

1.21 

0.02 

0.00 

0.03 

30043 

A 

1 

16 

31 

1.71 

0.26 

0.66 

0.61 

30043 

B 

0 

5 

10 

0.45 

0.41 

0.83 

-0.10 

30043 

C 

0 

15 

29 

0.39 

0.19 

0.77 

-0.23 

30043 

D 

0 

16 

31 

0.25 

0.19 

0.66 

-0.33 

30044 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.05 

30044 

A 

1 

31 

57 

0.90 

0.18 

0.95 

0.42 

30044 

B 

0 

4 

7 

0.75 

0.42 

1.73 

0.06 

30044 

C 

0 

5 

9 

0.23 

0.37 

1.05 

-0.10 

30044 

D 

0 

14 

26 

-0.17 

0.18 

0.65 

-0.44 

30045 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.03 

30045 

A 

1 

28 

52 

1.22 

0.22 

1.14 

0.39 

30045 

B 

0 

5 

9 

0.62 

0.22 

0.94 

-0.05 

30045 

C 

0 

12 

22 

0.40 

0.27 

0.95 

-0.19 

30045 

D 

0 

9 

17 

0.10 

0.39 

0.88 

-0.28 

30046 

* 

-1 

4944 

99 

1.21 

0.02 

0.00 

0.03 

30046 

A 

1 

25 

50 

1.56 

0.20 

0.75 

0.63 

30046 

B 

0 

9 

18 

0.24 

0.13 

0.60 

-0.27 

30046 

C 

0 

12 

24 

0.18 

0.26 

0.75 

-0.35 

30046 

D 

0 

4 

8 

0.02 

0.29 

0.51 

-0.23 

30047 

* 

-1 

4690 

94 

1.17 

0.02 

0.00 

-0.11 

30047 

A 

1 

264 

87 

2.02 

0.07 

0.90 

0.45 

30047 

B 

0 

19 

6 

0.38 

0.17 

0.51 

-0.30 

30047 

C 

0 

16 

5 

0.54 

0.22 

0.67 

-0.24 

30047 

D 

0 

5 

2 

0.02 

0.27 

0.31 

-0.19 

30048 

* 

-1 

4933 

99 

1.21 

0.02 

0.00 

0.06 

30048 

A 

1 

39 

64 

1.02 

0.12 

0.78 

0.56 

30048 

B 

0 

5 

8 

0.14 

0.33 

0.92 

-0.10 

30048 

C 

0 

6 

10 

-0.33 

0.43 

0.69 

-0.24 

30048 

D 

0 

11 

18 

-0.58 

0.48 

0.70 

-0.44 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30049 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.05 

30049 

A 

1 

29 

52 

0.91 

0.23 

1.36 

0.37 

30049 

B 

0 

4 

7 

-0.17 

0.29 

0.59 

-0.18 

30049 

C 

0 

8 

14 

0.07 

0.26 

0.84 

-0.17 

30049 

D 

0 

15 

27 

0.19 

0.19 

1.05 

-0.18 

30050 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30050 

A 

1 

44 

79 

1.05 

0.16 

0.89 

0.47 

30050 

B 

0 

2 

4 

-0.60 

0.25 

0.35 

-0.24 

30050 

C 

0 

1 

2 

0.68 

0.00 

1.22 

-0.01 

30050 

D 

0 

9 

16 

-0.23 

0.18 

0.56 

-0.40 

30051 

* 

-1 

4944 

99 

1.21 

0.02 

0.00 

0.03 

30051 

A 

1 

41 

82 

0.99 

0.14 

0.96 

0.44 

30051 

B 

0 

2 

4 

-0.02 

0.45 

0.63 

-0.18 

30051 

C 

0 

6 

12 

0.11 

0.25 

0.74 

-0.28 

30051 

D 

0 

1 

2 

-1.21 

0.00 

0.17 

-0.31 

30052 

* 

-1 

4943 

99 

1.21 

0.02 

0.00 

0.03 

30052 

A 

1 

44 

86 

1.00 

0.16 

0.96 

0.30 

30052 

B 

0 

5 

10 

0.28 

0.37 

0.98 

-0.18 

30052 

C 

0 

1 

2 

-0.98 

0.00 

0.22 

-0.24 

30052 

D 

0 

1 

2 

0.00 

0.00 

0.59 

-0.11 

30053 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.02 

30053 

A 

1 

45 

78 

1.14 

0.16 

1.01 

0.38 

30053 

B 

0 

10 

17 

0.07 

0.11 

0.58 

-0.37 

30053 

C 

0 

2 

3 

0.61 

0.05 

0.95 

-0.06 

30053 

D 

0 

1 

2 

0.51 

0.00 

0.86 

-0.05 

30054 

* 

-1 

4944 

99 

1.21 

0.02 

0.00 

0.02 

30054 

A 

1 

43 

86 

1.02 

0.14 

1.04 

0.28 

30054 

B 

0 

6 

12 

0.49 

0.27 

1.08 

-0.17 

30054 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30054 

D 

0 

1 

2 

-0.89 

0.00 

0.22 

-0.28 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30055 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.01 

30055 

A 

1 

55 

96 

1.13 

0.16 

0.86 

0.26 

30055 

B 

0 

1 

2 

-2.38 

0.00 

0.06 

-0.37 

30055 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30055 

D 

0 

1 

2 

1.10 

0.00 

2.02 

0.00 

30056 

* 

-1 

4943 

99 

1.21 

0.02 

0.00 

0.03 

30056 

A 

1 

40 

78 

1.13 

0.21 

0.91 

0.43 

30056 

B 

0 

2 

4 

-0.60 

0.22 

0.39 

-0.21 

30056 

C 

0 

7 

14 

-0.01 

0.21 

0.79 

-0.24 

30056 

D 

0 

2 

4 

-1.22 

1.45 

0.46 

-0.30 

30057 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

30057 

A 

1 

54 

95 

0.83 

0.14 

1.04 

0.26 

30057 

B 

0 

1 

2 

-1.25 

0.00 

0.21 

-0.25 

30057 

C 

0 

1 

2 

0.35 

0.00 

1.03 

-0.05 

30057 

D 

0 

1 

2 

-0.35 

0.00 

0.51 

-0.14 

30058 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.05 

30058 

A 

1 

43 

75 

0.68 

0.15 

1.15 

0.18 

30058 

B 

0 

1 

2 

-0.50 

0.00 

0.42 

-0.15 

30058 

C 

0 

1 

2 

-0.58 

0.00 

0.39 

-0.16 

30058 

D 

0 

12 

21 

0.40 

0.23 

1.45 

-0.09 

30059 

* 

-1 

4926 

99 

1.21 

0.02 

0.00 

0.01 

30059 

A 

1 

57 

84 

1.19 

0.13 

1.04 

0.26 

30059 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30059 

C 

0 

10 

15 

0.55 

0.18 

0.90 

-0.23 

30059 

D 

0 

1 

1 

0.37 

0.00 

0.64 

-0.09 

30060 

* 

-1 

4927 

99 

1.21 

0.02 

0.00 

0.03 

30060 

A 

1 

61 

91 

0.97 

0.17 

1.01 

0.31 

30060 

B 

0 

4 

6 

-0.79 

0.52 

0.53 

-0.30 

30060 

C 

0 

2 

3 

-0.01 

0.84 

1.10 

-0.11 

30060 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30061 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

30061 

A 

1 

54 

96 

0.69 

0.17 

1.05 

0.11 

30061 

B 

0 

2 

4 

-0.06 

0.41 

0.93 

-0.11 

30061 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30061 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30062 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.01 

30062 

A 

1 

50 

93 

1.20 

0.19 

0.94 

0.33 

30062 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30062 

C 

0 

2 

4 

-0.23 

0.40 

0.55 

-0.19 

30062 

D 

0 

2 

4 

-0.82 

0.17 

0.28 

-0.27 

30063 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.02 

30063 

A 

1 

52 

98 

0.94 

0.16 

0.97 

0.25 

30063 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30063 

C 

0 

1 

2 

-1.30 

0.00 

0.21 

-0.25 

30063 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30064 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

30064 

A 

1 

55 

96 

0.90 

0.16 

0.86 

0.36 

30064 

B 

0 

1 

2 

-0.78 

0.00 

0.37 

-0.17 

30064 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30064 

D 

0 

1 

2 

-2.29 

0.00 

0.08 

-0.34 

30065 

* 

-1 

4932 

99 

1.21 

0.02 

0.00 

0.03 

30065 

A 

1 

60 

97 

0.92 

0.15 

1.00 

0.15 

30065 

B 

0 

1 

2 

-0.50 

0.00 

0.40 

-0.16 

30065 

C 

0 

1 

2 

0.46 

0.00 

1.05 

-0.05 

30065 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30066 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.05 

30066 

A 

1 

55 

96 

0.66 

0.15 

0.81 

0.44 

30066 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30066 

C 

0 

1 

2 

-2.09 

0.00 

0.14 

-0.29 

30066 

D 

0 

1 

2 

-2.47 

0.00 

0.09 

-0.33 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30067 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.02 

30067 

A 

1 

51 

93 

1.06 

0.16 

0.92 

0.34 

30067 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30067 

C 

0 

3 

5 

-0.24 

0.56 

0.62 

-0.25 

30067 

D 

0 

1 

2 

-1.09 

0.00 

0.21 

-0.24 

30068 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.05 

30068 

A 

1 

59 

98 

0.62 

0.15 

1.03 

0.03 

30068 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30068 

C 

0 

1 

2 

0.35 

0.00 

1.31 

-0.03 

30068 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30069 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.03 

30069 

A 

1 

59 

98 

0.86 

0.12 

1.02 

0.06 

30069 

B 

0 

1 

2 

0.42 

0.00 

0.98 

-0.06 

30069 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30069 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30070 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.01 

30070 

A 

1 

54 

98 

1.10 

0.13 

0.97 

0.24 

30070 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30070 

C 

0 

1 

2 

-0.63 

0.00 

0.28 

-0.24 

30070 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30071 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.03 

30071 

A 

1 

8 

14 

1.89 

0.57 

1.00 

0.40 

30071 

B 

0 

32 

55 

0.58 

0.17 

0.86 

-0.20 

30071 

C 

0 

5 

9 

0.91 

0.36 

1.02 

0.04 

30071 

D 

0 

13 

22 

0.54 

0.25 

0.75 

-0.12 

30072 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.05 

30072 

A 

1 

8 

13 

0.76 

0.63 

3.32 

0.05 

30072 

B 

0 

28 

47 

0.66 

0.15 

0.95 

0.03 

30072 

C 

0 

12 

20 

0.76 

0.28 

1.31 

0.07 

30072 

D 

0 

12 

20 

0.32 

0.28 

0.81 

-0.15 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30073 

* 

-1 

4937 

99 

1.22 

0.02 

0.00 

0.06 

30073 

A 

1 

34 

60 

0.83 

0.17 

0.86 

0.40 

30073 

B 

0 

8 

14 

0.31 

0.52 

2.25 

-0.03 

30073 

C 

0 

5 

9 

0.01 

0.67 

2.00 

-0.09 

30073 

D 

0 

10 

18 

-0.80 

0.47 

0.68 

-0.42 

30074 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.03 

30074 

A 

1 

10 

19 

1.82 

0.64 

1.94 

0.38 

30074 

B 

0 

26 

49 

0.74 

0.18 

0.93 

-0.08 

30074 

C 

0 

10 

19 

0.63 

0.36 

0.92 

-0.08 

30074 

D 

0 

7 

13 

0.12 

0.07 

0.34 

-0.22 

30075 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.01 

30075 

A 

1 

32 

55 

1.33 

0.19 

1.21 

0.30 

30075 

B 

0 

12 

21 

0.94 

0.25 

1.30 

-0.06 

30075 

C 

0 

4 

7 

0.51 

0.35 

0.72 

-0.15 

30075 

D 

0 

10 

17 

0.56 

0.27 

0.85 

-0.23 

30076 

* 

-1 

4948 

99 

1.21 

0.02 

0.00 

0.03 

30076 

A 

1 

10 

22 

1.20 

0.56 

1.71 

0.22 

30076 

B 

0 

9 

20 

0.75 

0.26 

1.20 

0.01 

30076 

C 

0 

15 

33 

0.62 

0.21 

1.03 

-0.06 

30076 

D 

0 

12 

26 

0.44 

0.32 

1.15 

-0.15 

30077 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.01 

30077 

A 

1 

10 

17 

1.97 

0.42 

1.10 

0.37 

30077 

B 

0 

32 

55 

1.02 

0.18 

1.45 

-0.05 

30077 

C 

0 

3 

5 

0.55 

0.56 

0.59 

-0.11 

30077 

D 

0 

13 

22 

0.63 

0.23 

0.61 

-0.21 

30078 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.04 

30078 

A 

1 

16 

28 

1.05 

0.48 

2.51 

0.15 

30078 

B 

0 

29 

50 

0.79 

0.16 

1.36 

0.05 

30078 

C 

0 

5 

9 

0.53 

0.41 

0.96 

-0.05 

30078 

D 

0 

8 

14 

-0.01 

0.43 

1.09 

-0.23 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30079 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

30079 

A 

1 

11 

19 

1.30 

0.39 

1.77 

0.25 

30079 

B 

0 

8 

14 

0.67 

0.29 

0.95 

0.01 

30079 

C 

0 

31 

54 

0.67 

0.20 

1.60 

0.02 

30079 

D 

0 

7 

12 

-0.48 

0.65 

0.43 

-0.34 

30080 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.04 

30080 

A 

1 

22 

40 

1.22 

0.16 

0.82 

0.47 

30080 

B 

0 

11 

20 

0.58 

0.27 

1.13 

-0.05 

30080 

C 

0 

6 

11 

0.12 

0.55 

0.90 

-0.20 

30080 

D 

0 

16 

29 

0.17 

0.21 

0.84 

-0.33 

30081 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

30081 

A 

1 

7 

13 

1.37 

0.56 

2.46 

0.27 

30081 

B 

0 

1 

2 

-0.86 

0.00 

0.16 

-0.20 

30081 

C 

0 

45 

80 

0.64 

0.13 

0.98 

-0.02 

30081 

D 

0 

3 

5 

-0.40 

0.70 

0.37 

-0.25 

30082 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.03 

30082 

A 

1 

47 

81 

0.88 

0.18 

1.08 

0.19 

30082 

B 

0 

4 

7 

0.06 

0.67 

1.10 

-0.17 

30082 

C 

0 

5 

9 

0.70 

0.39 

1.75 

-0.02 

30082 

D 

0 

2 

3 

-0.06 

0.41 

0.67 

-0.13 

30083 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.05 

30083 

A 

1 

47 

80 

0.76 

0.13 

1.00 

0.27 

30083 

B 

0 

5 

8 

0.09 

0.46 

1.07 

-0.17 

30083 

C 

0 

4 

7 

0.95 

0.40 

2.22 

0.09 

30083 

D 

0 

3 

5 

-0.98 

0.06 

0.26 

-0.39 

30084 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.04 

30084 

A 

1 

9 

16 

1.37 

0.35 

1.00 

0.28 

30084 

B 

0 

1 

2 

1.58 

0.00 

1.73 

0.12 

30084 

C 

0 

41 

75 

0.70 

0.15 

1.15 

-0.05 

30084 

D 

0 

4 

7 

-0.62 

0.08 

0.19 

-0.38 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30085 

* 

-1 

4937 

99 

1.22 

0.02 

0.00 

0.07 

30085 

A 

1 

7 

12 

0.29 

0.67 

6.51 

-0.03 

30085 

B 

0 

4 

7 

1.27 

0.59 

2.11 

0.17 

30085 

C 

0 

39 

68 

0.62 

0.16 

1.30 

0.24 

30085 

D 

0 

7 

12 

-1.28 

0.80 

0.30 

-0.44 

30086 

* 

-1 

4709 

94 

1.18 

0.02 

0.00 

-0.08 

30086 

A 

1 

199 

70 

1.85 

0.08 

1.27 

0.28 

30086 

B 

0 

25 

9 

0.78 

0.16 

0.78 

-0.22 

30086 

C 

0 

57 

20 

1.47 

0.12 

1.49 

-0.07 

30086 

D 

0 

4 

1 

-1.94 

0.75 

0.07 

-0.35 

30087 

* 

-1 

4932 

99 

1.21 

0.02 

0.00 

0.03 

30087 

A 

1 

53 

85 

0.90 

0.12 

0.99 

0.28 

30087 

B 

0 

2 

3 

-0.11 

0.00 

0.51 

-0.19 

30087 

C 

0 

6 

10 

0.42 

0.25 

1.01 

-0.14 

30087 

D 

0 

1 

2 

-0.39 

0.00 

0.39 

-0.17 

30088 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

30088 

A 

1 

49 

86 

0.92 

0.15 

1.05 

0.24 

30088 

B 

0 

3 

5 

-0.12 

0.27 

0.57 

-0.22 

30088 

C 

0 

4 

7 

0.44 

0.14 

0.95 

-0.11 

30088 

D 

0 

1 

2 

0.44 

0.00 

0.93 

-0.05 

30089 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.04 

30089 

A 

1 

50 

83 

0.95 

0.12 

0.88 

0.39 

30089 

B 

0 

4 

7 

-0.74 

0.31 

0.35 

-0.40 

30089 

C 

0 

3 

5 

1.07 

0.75 

2.93 

0.07 

30089 

D 

0 

3 

5 

-0.43 

0.86 

0.84 

-0.27 

30090 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.05 

30090 

A 

1 

46 

81 

0.99 

0.14 

0.70 

0.59 

30090 

B 

0 

3 

5 

-0.06 

0.50 

0.92 

-0.13 

30090 

C 

0 

1 

2 

0.51 

0.00 

1.25 

-0.01 

30090 

D 

0 

7 

12 

-1.44 

0.47 

0.27 

-0.62 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30091 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.03 

30091 

A 

1 

23 

40 

1.43 

0.29 

1.21 

0.44 

30091 

B 

0 

3 

5 

-0.57 

0.34 

0.28 

-0.27 

30091 

C 

0 

12 

21 

0.43 

0.21 

0.90 

-0.16 

30091 

D 

0 

20 

34 

0.49 

0.18 

0.94 

-0.19 

30092 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.05 

30092 

A 

1 

25 

43 

1.24 

0.16 

0.76 

0.52 

30092 

B 

0 

3 

5 

-0.38 

0.21 

0.36 

-0.22 

30092 

C 

0 

14 

24 

0.61 

0.26 

1.42 

0.00 

30092 

D 

0 

16 

28 

-0.18 

0.23 

0.58 

-0.47 

30093 

* 

-1 

4943 

99 

1.21 

0.02 

0.00 

0.03 

30093 

A 

1 

32 

63 

1.17 

0.23 

1.07 

0.35 

30093 

B 

0 

4 

8 

-0.34 

0.22 

0.42 

-0.28 

30093 

C 

0 

4 

8 

1.34 

0.37 

2.54 

0.12 

30093 

D 

0 

11 

22 

0.12 

0.27 

0.81 

-0.30 

30094 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.05 

30094 

A 

1 

42 

72 

0.77 

0.11 

0.90 

0.45 

30094 

B 

0 

2 

3 

0.57 

0.94 

1.76 

0.01 

30094 

C 

0 

5 

9 

0.28 

0.11 

0.91 

-0.10 

30094 

D 

0 

9 

16 

-0.40 

0.24 

0.60 

-0.49 

30095 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30095 

A 

1 

38 

68 

1.13 

0.17 

1.00 

0.39 

30095 

B 

0 

3 

5 

-0.01 

0.40 

0.57 

-0.20 

30095 

C 

0 

6 

11 

1.05 

0.31 

1.89 

0.06 

30095 

D 

0 

9 

16 

-0.13 

0.20 

0.52 

-0.42 

30096 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.06 

30096 

A 

1 

11 

21 

0.60 

0.28 

1.62 

0.08 

30096 

B 

0 

9 

17 

0.71 

0.53 

3.54 

0.11 

30096 

C 

0 

16 

30 

0.49 

0.29 

1.22 

0.04 

30096 

D 

0 

17 

32 

0.07 

0.28 

0.98 

-0.20 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30097 

* 

-1 

4937 

99 

1.22 

0.02 

0.00 

0.07 

30097 

A 

1 

31 

54 

1.18 

0.21 

0.73 

0.58 

30097 

B 

0 

9 

16 

-0.14 

0.15 

0.67 

-0.13 

30097 

C 

0 

1 

2 

0.34 

0.00 

0.99 

0.00 

30097 

D 

0 

16 

28 

-1.03 

0.45 

0.61 

-0.54 

30098 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.02 

30098 

A 

1 

37 

64 

1.49 

0.19 

0.77 

0.60 

30098 

B 

0 

5 

9 

-0.14 

0.36 

0.57 

-0.25 

30098 

C 

0 

7 

12 

-0.24 

0.34 

0.52 

-0.33 

30098 

D 

0 

9 

16 

-0.04 

0.34 

0.78 

-0.31 

30099 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.02 

30099 

A 

1 

36 

68 

1.31 

0.19 

0.98 

0.41 

30099 

B 

0 

4 

8 

0.77 

0.42 

1.34 

-0.05 

30099 

C 

0 

2 

4 

0.66 

1.03 

1.47 

-0.05 

30099 

D 

0 

11 

21 

0.05 

0.24 

0.73 

-0.41 

30100 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.03 

30100 

A 

1 

37 

64 

1.22 

0.15 

0.85 

0.52 

30100 

B 

0 

7 

12 

0.28 

0.33 

0.91 

-0.20 

30100 

C 

0 

3 

5 

-0.28 

0.27 

0.41 

-0.26 

30100 

D 

0 

11 

19 

0.17 

0.22 

0.80 

-0.32 

30101 

* 

-1 

4945 

99 

1.21 

0.02 

0.00 

0.03 

30101 

A 

1 

41 

84 

1.21 

0.19 

0.65 

0.60 

30101 

B 

0 

1 

2 

0.42 

0.00 

1.22 

-0.04 

30101 

C 

0 

5 

10 

-1.27 

0.47 

0.34 

-0.47 

30101 

D 

0 

2 

4 

-1.97 

0.29 

0.12 

-0.38 

30102 

* 

-1 

4957 

99 

1.21 

0.02 

0.00 

0.02 

30102 

A 

1 

33 

89 

1.21 

0.15 

0.80 

0.70 

30102 

B 

0 

2 

5 

-1.16 

0.73 

0.22 

-0.33 

30102 

C 

0 

1 

3 

-0.38 

0.00 

0.37 

-0.14 

30102 

D 

0 

1 

3 

-5.70 

0.00 

0.00 

-0.74 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30103 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.01 

30103 

A 

1 

49 

86 

1.19 

0.15 

0.98 

0.36 

30103 

B 

0 

6 

11 

0.23 

0.42 

0.98 

-0.24 

30103 

C 

0 

2 

4 

-0.54 

1.07 

0.51 

-0.27 

30103 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30104 

* 

-1 

4954 

99 

1.21 

0.02 

0.00 

0.04 

30104 

A 

1 

26 

65 

0.98 

0.19 

0.86 

0.49 

30104 

B 

0 

8 

20 

-0.08 

0.26 

0.79 

-0.36 

30104 

C 

0 

5 

13 

0.02 

0.32 

0.78 

-0.23 

30104 

D 

0 

1 

3 

0.10 

0.00 

0.69 

-0.09 

30105 

* 

-1 

4951 

99 

1.21 

0.02 

0.00 

0.03 

30105 

A 

1 

31 

72 

0.90 

0.21 

1.10 

0.25 

30105 

B 

0 

6 

14 

0.37 

0.36 

1.18 

-0.14 

30105 

C 

0 

5 

12 

0.35 

0.36 

1.08 

-0.13 

30105 

D 

0 

1 

2 

-0.39 

0.00 

0.41 

-0.16 

30106 

* 

-1 

4949 

99 

1.21 

0.02 

0.00 

0.03 

30106 

A 

1 

39 

87 

0.91 

0.18 

1.02 

0.33 

30106 

B 

0 

4 

9 

-0.75 

0.60 

0.64 

-0.39 

30106 

C 

0 

1 

2 

0.92 

0.00 

1.88 

0.02 

30106 

D 

0 

1 

2 

0.55 

0.00 

1.29 

-0.03 

30107 

* 

-1 

4950 

99 

1.21 

0.02 

0.00 

0.02 

30107 

A 

1 

40 

91 

1.13 

0.15 

0.78 

0.55 

30107 

B 

0 

3 

7 

-0.96 

0.60 

0.31 

-0.47 

30107 

C 

0 

1 

2 

-1.05 

0.00 

0.22 

-0.28 

30107 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30108 

* 

-1 

4951 

99 

1.21 

0.02 

0.00 

0.01 

30108 

A 

1 

40 

93 

1.17 

0.18 

0.94 

0.35 

30108 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30108 

C 

0 

2 

5 

-0.56 

0.14 

0.33 

-0.30 

30108 

D 

0 

1 

2 

-0.26 

0.00 

0.44 

-0.17 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30109 

* 

-1 

4947 

99 

1.21 

0.02 

0.00 

0.03 

30109 

A 

1 

35 

74 

1.03 

0.19 

0.95 

0.38 

30109 

B 

0 

8 

17 

-0.18 

0.19 

0.56 

-0.40 

30109 

C 

0 

4 

9 

0.58 

0.30 

1.18 

-0.06 

30109 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30110 

* 

-1 

4955 

99 

1.21 

0.02 

0.00 

0.01 

30110 

A 

1 

36 

92 

1.21 

0.20 

0.89 

0.41 

30110 

B 

0 

1 

3 

-0.70 

0.00 

0.29 

-0.23 

30110 

C 

0 

2 

5 

-0.69 

0.37 

0.32 

-0.33 

30110 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30111 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.02 

30111 

A 

1 

51 

96 

0.93 

0.16 

1.08 

0.02 

30111 

B 

0 

1 

2 

1.28 

0.00 

2.43 

0.04 

30111 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30111 

D 

0 

1 

2 

0.34 

0.00 

0.95 

-0.07 

30112 

* 

-1 

4950 

99 

1.21 

0.02 

0.00 

0.04 

30112 

A 

-1 

44 

100 

0.65 

0.13 

0.00 

0.00 

30112 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30112 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30112 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30113 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.02 

30113 

A 

1 

51 

94 

0.92 

0.12 

1.04 

0.11 

30113 

B 

0 

2 

4 

0.68 

0.03 

1.08 

-0.05 

30113 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30113 

D 

0 

1 

2 

0.22 

0.00 

0.68 

-0.11 

30114 

* 

-1 

4943 

99 

1.21 

0.02 

0.00 

0.02 

30114 

A 

1 

43 

84 

1.06 

0.19 

0.99 

0.29 

30114 

B 

0 

6 

12 

-0.02 

0.39 

0.82 

-0.27 

30114 

C 

0 

1 

2 

0.84 

0.00 

1.41 

-0.01 

30114 

D 

0 

1 

2 

-0.13 

0.00 

0.53 

-0.12 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30115 

* 

-1 

4951 

99 

1.21 

0.02 

0.00 

0.01 

30115 

A 

1 

42 

98 

1.09 

0.17 

0.96 

0.24 

30115 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30115 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30115 

D 

0 

1 

2 

-0.69 

0.00 

0.29 

-0.24 

30116 

* 

-1 

4958 

99 

1.21 

0.02 

0.00 

0.02 

30116 

A 

1 

33 

92 

0.97 

0.23 

1.13 

0.13 

30116 

B 

0 

2 

6 

0.82 

0.12 

1.62 

-0.02 

30116 

C 

0 

1 

3 

-0.49 

0.00 

0.43 

-0.19 

30116 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30117 

* 

-1 

4948 

99 

1.21 

0.02 

0.00 

0.04 

30117 

A 

1 

37 

80 

0.87 

0.15 

0.84 

0.57 

30117 

B 

0 

6 

13 

-0.57 

0.15 

0.43 

-0.45 

30117 

C 

0 

1 

2 

-0.39 

0.00 

0.49 

-0.15 

30117 

D 

0 

2 

4 

-0.61 

0.23 

0.40 

-0.26 

30118 

* 

-1 

4955 

99 

1.21 

0.02 

0.00 

0.05 

30118 

A 

1 

38 

97 

0.45 

0.16 

1.06 

-0.07 

30118 

B 

0 

1 

3 

0.89 

0.00 

2.50 

0.07 

30118 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30118 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30119 

* 

-1 

4939 

99 

1.22 

0.02 

0.00 

0.07 

30119 

A 

1 

46 

84 

0.70 

0.21 

2.11 

0.52 

30119 

B 

0 

2 

4 

-0.83 

0.25 

0.58 

-0.14 

30119 

C 

0 

4 

7 

-1.75 

0.86 

0.41 

-0.36 

30119 

D 

0 

3 

5 

-1.93 

1.02 

0.39 

-0.33 

30120 

* 

-1 

4928 

99 

1.21 

0.02 

0.00 

0.06 

30120 

A 

1 

60 

91 

0.69 

0.12 

0.88 

0.39 

30120 

B 

0 

2 

3 

-0.70 

1.20 

0.77 

-0.21 

30120 

C 

0 

2 

3 

-1.59 

0.74 

0.22 

-0.36 

30120 

D 

0 

2 

3 

0.06 

0.36 

0.96 

-0.08 
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Appendix  E:  Distractor  Statistics 


Item  ID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30121 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.03 

30121 

A 

1 

54 

98 

0.78 

0.14 

1.05 

0.06 

30121 

B 

0 

1 

2 

0.35 

0.00 

1.13 

-0.06 

30121 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30121 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30122 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.02 

30122 

A 

1 

53 

93 

1.03 

0.14 

0.79 

0.39 

30122 

B 

0 

3 

5 

-0.17 

1.01 

1.47 

-0.23 

30122 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30122 

D 

0 

1 

2 

-2.27 

0.00 

0.07 

-0.38 

30123 

* 

-1 

4942 

99 

1.21 

0.02 

0.00 

0.04 

30123 

A 

1 

46 

88 

0.80 

0.16 

1.07 

0.21 

30123 

B 

0 

1 

2 

0.07 

0.00 

0.74 

-0.09 

30123 

C 

0 

5 

10 

0.15 

0.21 

0.88 

-0.18 

30123 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30124 

* 

-1 

4952 

99 

1.21 

0.02 

0.00 

0.03 

30124 

A 

1 

36 

86 

0.98 

0.17 

0.90 

0.37 

30124 

B 

0 

3 

7 

0.16 

0.07 

0.79 

-0.16 

30124 

C 

0 

3 

7 

-0.61 

1.08 

1.10 

-0.35 

30124 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30125 

* 

-1 

4956 

99 

1.21 

0.02 

0.00 

0.02 

30125 

A 

1 

37 

97 

1.07 

0.13 

0.39 

0.74 

30125 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30125 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30125 

D 

0 

1 

3 

-4.18 

0.00 

0.02 

-0.74 

30126 

* 

-1 

4957 

99 

1.21 

0.02 

0.00 

0.03 

30126 

A 

1 

12 

32 

1.01 

0.23 

1.27 

0.13 

30126 

B 

0 

3 

8 

1.07 

0.08 

1.09 

0.07 

30126 

C 

0 

21 

57 

0.88 

0.18 

1.18 

0.09 

30126 

D 

0 

1 

3 

-4.46 

0.00 

0.00 

-0.76 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30127 

* 

-1 

4943 

99 

1.21 

0.02 

0.00 

0.01 

30127 

A 

1 

50 

98 

1.17 

0.15 

0.97 

0.23 

30127 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30127 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30127 

D 

0 

1 

2 

-0.65 

0.00 

0.28 

-0.23 

30128 

* 

-1 

4944 

99 

1.21 

0.02 

0.00 

0.02 

30128 

A 

1 

47 

94 

1.08 

0.15 

0.97 

0.40 

30128 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30128 

C 

0 

1 

2 

-0.63 

0.00 

0.33 

-0.22 

30128 

D 

0 

2 

4 

-0.69 

0.41 

0.33 

-0.32 

30129 

* 

-1 

4946 

99 

1.21 

0.02 

0.00 

0.03 

30129 

A 

1 

43 

90 

0.86 

0.16 

0.94 

0.25 

30129 

B 

0 

2 

4 

-0.34 

0.58 

0.58 

-0.22 

30129 

C 

0 

3 

6 

0.21 

0.96 

1.55 

-0.14 

30129 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30130 

* 

-1 

4959 

99 

1.21 

0.02 

0.00 

0.03 

30130 

A 

1 

10 

29 

0.88 

0.37 

1.78 

0.06 

30130 

B 

0 

4 

11 

0.74 

0.29 

0.89 

-0.01 

30130 

C 

0 

17 

49 

0.98 

0.23 

1.67 

0.19 

30130 

D 

0 

4 

11 

-0.34 

0.65 

0.40 

-0.38 

30131 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.05 

30131 

A 

1 

50 

85 

0.77 

0.14 

0.85 

0.49 

30131 

B 

0 

4 

7 

-0.34 

0.31 

0.65 

-0.23 

30131 

C 

0 

1 

2 

0.12 

0.00 

0.91 

-0.05 

30131 

D 

0 

4 

7 

-1.22 

0.32 

0.27 

-0.45 

30132 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.06 

30132 

A 

1 

44 

75 

0.60 

0.17 

1.14 

0.16 

30132 

B 

0 

14 

24 

0.29 

0.29 

1.65 

-0.10 

30132 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30132 

D 

0 

1 

2 

-1.15 

0.00 

0.25 

-0.20 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30133 

* 

-1 

4928 

99 

1.21 

0.02 

0.00 

0.04 

30133 

A 

1 

47 

71 

1.02 

0.13 

0.95 

0.45 

30133 

B 

0 

6 

9 

0.35 

0.49 

1.42 

-0.12 

30133 

C 

0 

10 

15 

0.10 

0.18 

0.72 

-0.28 

30133 

D 

0 

3 

5 

-0.76 

0.45 

0.32 

-0.33 

30134 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.04 

30134 

A 

1 

51 

94 

0.83 

0.15 

0.85 

0.39 

30134 

B 

0 

2 

4 

-0.24 

0.04 

0.72 

-0.16 

30134 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30134 

D 

0 

1 

2 

-3.04 

0.00 

0.04 

-0.43 

30135 

* 

-1 

4957 

99 

1.21 

0.02 

0.00 

0.04 

30135 

A 

1 

36 

97 

0.72 

0.18 

0.47 

0.61 

30135 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30135 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30135 

D 

0 

1 

3 

-4.18 

0.00 

0.02 

-0.61 

30136 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.03 

30136 

A 

1 

12 

22 

1.48 

0.57 

2.54 

0.24 

30136 

B 

0 

7 

13 

0.76 

0.48 

1.19 

-0.03 

30136 

C 

0 

28 

51 

0.75 

0.20 

1.32 

-0.10 

30136 

D 

0 

8 

15 

0.51 

0.30 

0.69 

-0.12 

30137 

* 

-1 

4933 

99 

1.21 

0.02 

0.00 

0.02 

30137 

A 

1 

49 

80 

0.97 

0.14 

1.15 

0.11 

30137 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30137 

C 

0 

4 

7 

1.33 

0.83 

5.69 

0.10 

30137 

D 

0 

8 

13 

0.35 

0.56 

1.48 

-0.20 

30138 

* 

-1 

4927 

99 

1.21 

0.02 

0.00 

0.02 

30138 

A 

1 

51 

76 

0.99 

0.12 

1.05 

0.12 

30138 

B 

0 

5 

7 

-0.06 

0.26 

0.52 

-0.31 

30138 

C 

0 

6 

9 

1.10 

0.57 

2.45 

0.06 

30138 

D 

0 

5 

7 

1.06 

0.42 

1.96 

0.04 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30139 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30139 

A 

1 

53 

95 

0.83 

0.13 

1.03 

0.13 

30139 

B 

0 

1 

2 

0.07 

0.00 

0.71 

-0.10 

30139 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30139 

D 

0 

2 

4 

0.38 

1.05 

1.55 

-0.09 

30140 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.04 

30140 

A 

1 

45 

78 

1.07 

0.19 

0.90 

0.44 

30140 

B 

0 

2 

3 

-0.16 

0.54 

0.72 

-0.12 

30140 

C 

0 

4 

7 

0.41 

0.27 

1.24 

-0.06 

30140 

D 

0 

7 

12 

-1.05 

0.61 

0.57 

-0.46 

30141 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.05 

30141 

A 

1 

43 

74 

0.96 

0.15 

0.85 

0.54 

30141 

B 

0 

7 

12 

-0.51 

0.18 

0.44 

-0.42 

30141 

C 

0 

6 

10 

0.15 

0.14 

0.81 

-0.16 

30141 

D 

0 

2 

3 

-0.90 

0.17 

0.27 

-0.28 

30142 

* 

-1 

4928 

99 

1.21 

0.02 

0.00 

0.04 

30142 

A 

1 

47 

71 

1.12 

0.12 

0.79 

0.50 

30142 

B 

0 

7 

11 

0.83 

0.43 

2.10 

0.02 

30142 

C 

0 

5 

8 

0.29 

0.18 

0.81 

-0.11 

30142 

D 

0 

7 

11 

-1.52 

0.46 

0.19 

-0.66 

30143 

* 

-1 

4947 

99 

1.21 

0.02 

0.00 

0.02 

30143 

A 

1 

42 

89 

0.95 

0.17 

0.98 

0.17 

30143 

B 

0 

1 

2 

2.38 

0.00 

6.73 

0.20 

30143 

C 

0 

1 

2 

1.36 

0.00 

2.42 

0.06 

30143 

D 

0 

3 

6 

-0.66 

0.34 

0.36 

-0.36 

30144 

* 

-1 

4946 

99 

1.21 

0.02 

0.00 

0.04 

30144 

A 

1 

35 

73 

0.75 

0.19 

1.15 

0.13 

30144 

B 

0 

5 

10 

1.11 

0.47 

3.06 

0.15 

30144 

C 

0 

2 

4 

-0.23 

0.40 

0.56 

-0.18 

30144 

D 

0 

6 

13 

0.11 

0.22 

0.82 

-0.20 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30145 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.03 

30145 

A 

1 

51 

86 

1.04 

0.16 

0.95 

0.37 

30145 

B 

0 

3 

5 

0.20 

0.26 

0.81 

-0.14 

30145 

C 

0 

2 

3 

-0.19 

1.10 

0.86 

-0.17 

30145 

D 

0 

3 

5 

-0.57 

0.40 

0.41 

-0.29 

30146 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30146 

A 

1 

35 

63 

1.19 

0.23 

1.14 

0.35 

30146 

B 

0 

5 

9 

0.07 

0.68 

1.12 

-0.18 

30146 

C 

0 

8 

14 

0.57 

0.29 

1.26 

-0.08 

30146 

D 

0 

8 

14 

-0.02 

0.32 

0.79 

-0.26 

30147 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.04 

30147 

A 

1 

44 

75 

0.81 

0.16 

1.13 

0.16 

30147 

B 

0 

6 

10 

1.15 

0.55 

3.50 

0.14 

30147 

C 

0 

2 

3 

-0.51 

0.70 

0.48 

-0.21 

30147 

D 

0 

7 

12 

0.03 

0.17 

0.72 

-0.23 

30148 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

30148 

A 

1 

41 

73 

0.90 

0.14 

1.00 

0.31 

30148 

B 

0 

5 

9 

0.57 

0.27 

1.15 

-0.06 

30148 

C 

0 

5 

9 

0.40 

0.39 

1.15 

-0.12 

30148 

D 

0 

5 

9 

-0.13 

0.33 

0.64 

-0.31 

30149 

* 

-1 

4954 

99 

1.21 

0.02 

0.00 

0.03 

30149 

A 

1 

29 

73 

1.11 

0.21 

0.86 

0.52 

30149 

B 

0 

3 

8 

-1.27 

0.59 

0.24 

-0.45 

30149 

C 

0 

6 

15 

0.16 

0.32 

0.89 

-0.19 

30149 

D 

0 

2 

5 

-0.42 

0.76 

0.55 

-0.21 

30150 

* 

-1 

4951 

99 

1.21 

0.02 

0.00 

0.04 

30150 

A 

1 

26 

60 

1.02 

0.20 

0.94 

0.48 

30150 

B 

0 

8 

19 

0.28 

0.22 

0.93 

-0.16 

30150 

C 

0 

6 

14 

-0.02 

0.31 

0.71 

-0.26 

30150 

D 

0 

3 

7 

-0.59 

0.40 

0.39 

-0.33 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30151 

* 

-1 

4923 

99 

1.21 

0.02 

0.00 

0.03 

30151 

A 

1 

57 

80 

1.13 

0.14 

2.87 

0.45 

30151 

B 

0 

4 

6 

-0.39 

0.41 

0.46 

-0.27 

30151 

C 

0 

1 

1 

0.01 

0.00 

0.54 

-0.09 

30151 

D 

0 

9 

13 

-0.05 

0.29 

0.69 

-0.31 

30152 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

30152 

A 

1 

47 

82 

0.89 

0.17 

0.95 

0.38 

30152 

B 

0 

2 

4 

-1.05 

0.13 

0.27 

-0.28 

30152 

C 

0 

5 

9 

-0.23 

0.51 

1.05 

-0.24 

30152 

D 

0 

3 

5 

0.05 

0.15 

0.82 

-0.12 

30153 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30153 

A 

1 

40 

71 

1.11 

0.14 

0.79 

0.55 

30153 

B 

0 

5 

9 

0.48 

0.18 

0.96 

-0.09 

30153 

C 

0 

1 

2 

-1.21 

0.00 

0.17 

-0.27 

30153 

D 

0 

10 

18 

-0.25 

0.20 

0.54 

-0.48 

30154 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.05 

30154 

A 

1 

42 

75 

0.74 

0.15 

1.01 

0.37 

30154 

B 

0 

5 

9 

0.04 

0.32 

0.91 

-0.17 

30154 

C 

0 

2 

4 

-0.55 

0.66 

0.50 

-0.23 

30154 

D 

0 

7 

13 

0.01 

0.15 

0.77 

-0.22 

30155 

* 

-1 

4926 

99 

1.21 

0.02 

0.00 

0.03 

30155 

A 

1 

58 

85 

1.03 

0.12 

0.91 

0.46 

30155 

B 

0 

4 

6 

0.05 

0.44 

0.81 

-0.20 

30155 

C 

0 

2 

3 

-0.65 

0.30 

0.32 

-0.26 

30155 

D 

0 

4 

6 

-0.40 

0.39 

0.50 

-0.31 

30156 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.02 

30156 

A 

1 

39 

66 

1.27 

0.15 

1.06 

0.42 

30156 

B 

0 

2 

3 

0.79 

0.45 

1.06 

-0.03 

30156 

C 

0 

14 

24 

0.57 

0.23 

1.02 

-0.21 

30156 

D 

0 

4 

7 

-0.61 

0.42 

0.32 

-0.41 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30157 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

30157 

A 

1 

31 

54 

1.44 

0.21 

0.80 

0.51 

30157 

B 

0 

6 

11 

0.83 

0.40 

1.55 

-0.01 

30157 

C 

0 

11 

19 

0.23 

0.21 

0.74 

-0.24 

30157 

D 

0 

9 

16 

-0.40 

0.32 

0.47 

-0.44 

30158 

* 

-1 

4933 

99 

1.21 

0.02 

0.00 

0.04 

30158 

A 

1 

48 

79 

0.84 

0.12 

0.96 

0.35 

30158 

B 

0 

4 

7 

0.16 

0.09 

0.75 

-0.15 

30158 

C 

0 

6 

10 

0.23 

0.62 

1.98 

-0.16 

30158 

D 

0 

3 

5 

-0.39 

0.30 

0.46 

-0.27 

30159 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.06 

30159 

A 

1 

44 

76 

0.70 

0.15 

0.95 

0.38 

30159 

B 

0 

5 

9 

-0.11 

0.31 

0.83 

-0.18 

30159 

C 

0 

6 

10 

-0.19 

0.23 

0.72 

-0.23 

30159 

D 

0 

3 

5 

-0.33 

0.43 

0.65 

-0.19 

30160 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.03 

30160 

A 

1 

43 

74 

1.06 

0.17 

0.96 

0.42 

30160 

B 

0 

5 

9 

0.52 

0.55 

1.81 

-0.07 

30160 

C 

0 

4 

7 

-0.08 

0.25 

0.62 

-0.20 

30160 

D 

0 

6 

10 

-0.50 

0.35 

0.51 

-0.38 

30161 

* 

-1 

4945 

99 

1.21 

0.02 

0.00 

0.03 

30161 

A 

1 

47 

96 

0.92 

0.13 

0.93 

0.38 

30161 

B 

0 

2 

4 

-0.93 

0.28 

0.27 

-0.38 

30161 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30161 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30162 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.05 

30162 

A 

1 

23 

40 

1.35 

0.28 

1.10 

0.54 

30162 

B 

0 

7 

12 

0.58 

0.21 

1.10 

0.00 

30162 

C 

0 

11 

19 

0.02 

0.19 

0.68 

-0.23 

30162 

D 

0 

17 

29 

-0.14 

0.19 

0.61 

-0.39 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30163 

* 

-1 

4925 

99 

1.21 

0.02 

0.00 

0.05 

30163 

A 

1 

44 

64 

1.15 

0.14 

0.82 

0.53 

30163 

B 

0 

8 

12 

0.12 

0.35 

0.95 

-0.16 

30163 

C 

0 

12 

17 

-0.21 

0.29 

0.64 

-0.33 

30163 

D 

0 

5 

7 

-0.70 

0.95 

0.74 

-0.31 

30164 

* 

-1 

4946 

99 

1.21 

0.02 

0.00 

0.03 

30164 

A 

1 

46 

96 

0.85 

0.15 

0.92 

0.31 

30164 

B 

0 

1 

2 

-0.46 

0.00 

0.44 

-0.17 

30164 

C 

0 

1 

2 

-1.20 

0.00 

0.21 

-0.27 

30164 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30165 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.03 

30165 

A 

1 

37 

67 

1.23 

0.18 

0.80 

0.49 

30165 

B 

0 

5 

9 

0.67 

0.69 

2.88 

-0.04 

30165 

C 

0 

3 

5 

-0.31 

0.89 

0.95 

-0.22 

30165 

D 

0 

10 

18 

-0.33 

0.17 

0.47 

-0.44 

30166 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.02 

30166 

A 

1 

46 

81 

1.22 

0.16 

0.83 

0.52 

30166 

B 

0 

7 

12 

0.02 

0.25 

0.68 

-0.29 

30166 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30166 

D 

0 

4 

7 

-0.90 

0.14 

0.24 

-0.43 

30167 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.04 

30167 

A 

1 

47 

81 

1.04 

0.17 

0.81 

0.48 

30167 

B 

0 

6 

10 

-0.37 

0.56 

1.02 

-0.29 

30167 

C 

0 

2 

3 

-1.13 

0.06 

0.24 

-0.27 

30167 

D 

0 

3 

5 

-0.51 

0.85 

0.93 

-0.22 

30168 

* 

-1 

4947 

99 

1.21 

0.02 

0.00 

0.04 

30168 

A 

1 

31 

66 

0.98 

0.20 

1.02 

0.42 

30168 

B 

0 

5 

11 

0.63 

0.24 

1.34 

0.01 

30168 

C 

0 

2 

4 

-0.20 

0.41 

0.58 

-0.13 

30168 

D 

0 

9 

19 

-0.57 

0.50 

0.67 

-0.45 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30169 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.05 

30169 

A 

1 

40 

70 

0.88 

0.14 

0.89 

0.44 

30169 

B 

0 

3 

5 

-0.96 

0.72 

0.39 

-0.31 

30169 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30169 

D 

0 

14 

25 

-0.07 

0.38 

1.15 

-0.30 

30170 

* 

-1 

4931 

99 

1.21 

0.02 

0.00 

0.03 

30170 

A 

1 

35 

56 

1.10 

0.14 

1.03 

0.36 

30170 

B 

0 

7 

11 

0.97 

0.15 

1.28 

0.06 

30170 

C 

0 

5 

8 

0.33 

0.52 

0.97 

-0.15 

30170 

D 

0 

16 

25 

0.24 

0.23 

0.83 

-0.36 

30171 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.04 

30171 

A 

1 

20 

36 

1.41 

0.23 

1.14 

0.40 

30171 

B 

0 

9 

16 

1.07 

0.22 

1.32 

0.11 

30171 

C 

0 

4 

7 

0.27 

0.57 

0.83 

-0.11 

30171 

D 

0 

22 

40 

0.10 

0.29 

0.72 

-0.42 

30172 

* 

-1 

4947 

99 

1.21 

0.02 

0.00 

0.04 

30172 

A 

1 

18 

38 

1.10 

0.22 

1.00 

0.34 

30172 

B 

0 

4 

9 

-0.10 

0.52 

0.63 

-0.24 

30172 

C 

0 

8 

17 

0.91 

0.32 

1.68 

0.11 

30172 

D 

0 

17 

36 

0.30 

0.22 

0.96 

-0.29 

30173 

* 

-1 

4930 

99 

1.21 

0.02 

0.00 

0.03 

30173 

A 

1 

16 

25 

1.13 

0.24 

1.47 

0.16 

30173 

B 

0 

11 

17 

1.05 

0.33 

1.51 

0.09 

30173 

C 

0 

11 

17 

1.14 

0.36 

2.03 

0.13 

30173 

D 

0 

26 

41 

0.42 

0.20 

0.84 

-0.31 

30174 

* 

-1 

4935 

99 

1.22 

0.02 

0.00 

0.06 

30174 

A 

1 

32 

54 

1.07 

0.22 

0.96 

0.53 

30174 

B 

0 

21 

36 

-0.10 

0.18 

0.89 

-0.28 

30174 

C 

0 

2 

3 

-0.22 

0.51 

0.64 

-0.09 

30174 

D 

0 

4 

7 

-1.76 

0.80 

0.24 

-0.43 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30175 

* 

-1 

4935 

99 

1.22 

0.02 

0.00 

0.07 

30175 

A 

1 

34 

58 

0.87 

0.15 

0.84 

0.48 

30175 

B 

0 

21 

36 

0.13 

0.17 

1.02 

-0.17 

30175 

C 

0 

1 

2 

-2.27 

0.00 

0.07 

-0.30 

30175 

D 

0 

3 

5 

-2.30 

0.85 

0.12 

-0.54 

30176 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.06 

30176 

A 

1 

35 

61 

0.80 

0.16 

0.94 

0.43 

30176 

B 

0 

3 

5 

0.97 

0.31 

1.98 

0.12 

30176 

C 

0 

3 

5 

-0.55 

0.38 

0.46 

-0.25 

30176 

D 

0 

16 

28 

-0.15 

0.19 

0.78 

-0.40 

30177 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.05 

30177 

A 

1 

30 

55 

0.99 

0.18 

1.17 

0.47 

30177 

B 

0 

3 

5 

0.24 

0.18 

0.75 

-0.09 

30177 

C 

0 

4 

7 

-0.14 

0.54 

0.72 

-0.21 

30177 

D 

0 

18 

33 

0.12 

0.14 

0.76 

-0.34 

30178 

* 

-1 

4947 

99 

1.21 

0.02 

0.00 

0.02 

30178 

A 

1 

25 

53 

1.62 

0.20 

0.70 

0.60 

30178 

B 

0 

6 

13 

0.51 

0.46 

1.14 

-0.12 

30178 

C 

0 

2 

4 

0.44 

0.05 

0.65 

-0.08 

30178 

D 

0 

14 

30 

-0.15 

0.30 

0.53 

-0.54 

30179 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

30179 

A 

1 

19 

34 

1.43 

0.20 

0.81 

0.51 

30179 

B 

0 

6 

11 

0.75 

0.37 

1.17 

0.03 

30179 

C 

0 

4 

7 

0.65 

0.28 

0.93 

-0.01 

30179 

D 

0 

27 

48 

0.12 

0.19 

0.75 

-0.50 

30180 

* 

-1 

4942 

99 

1.21 

0.02 

0.00 

0.04 

30180 

A 

1 

11 

21 

1.56 

0.23 

0.78 

0.38 

30180 

B 

0 

8 

15 

0.68 

0.29 

0.90 

-0.01 

30180 

C 

0 

5 

10 

0.24 

0.87 

1.57 

-0.14 

30180 

D 

0 

28 

54 

0.47 

0.20 

0.91 

-0.23 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30181 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

30181 

A 

1 

13 

23 

0.73 

0.39 

3.82 

0.02 

30181 

B 

0 

8 

14 

0.30 

0.38 

0.82 

-0.14 

30181 

C 

0 

11 

20 

0.81 

0.25 

1.14 

0.05 

30181 

D 

0 

24 

43 

0.73 

0.24 

1.58 

0.04 

30182 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.02 

30182 

A 

1 

30 

52 

1.26 

0.18 

1.12 

0.40 

30182 

B 

0 

25 

43 

0.59 

0.14 

0.95 

-0.29 

30182 

C 

0 

3 

5 

-0.06 

0.04 

0.39 

-0.24 

30182 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30183 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

30183 

A 

1 

33 

58 

0.89 

0.20 

1.20 

0.24 

30183 

B 

0 

19 

33 

0.45 

0.20 

1.19 

-0.13 

30183 

C 

0 

3 

5 

0.81 

0.92 

2.82 

0.03 

30183 

D 

0 

2 

4 

-1.43 

0.69 

0.17 

-0.36 

30184 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.06 

30184 

A 

1 

33 

58 

0.83 

0.21 

1.17 

0.34 

30184 

B 

0 

20 

35 

0.26 

0.22 

1.33 

-0.11 

30184 

C 

0 

2 

4 

-1.16 

0.40 

0.23 

-0.24 

30184 

D 

0 

2 

4 

-2.24 

1.81 

0.23 

-0.40 

30185 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.03 

30185 

A 

1 

34 

62 

1.23 

0.18 

0.91 

0.48 

30185 

B 

0 

1 

2 

0.63 

0.00 

0.94 

-0.02 

30185 

C 

0 

10 

18 

0.50 

0.17 

0.95 

-0.14 

30185 

D 

0 

10 

18 

-0.21 

0.25 

0.52 

-0.45 

30186 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.02 

30186 

A 

1 

45 

80 

1.20 

0.16 

1.06 

0.45 

30186 

B 

0 

2 

4 

-0.17 

1.01 

0.71 

-0.19 

30186 

C 

0 

2 

4 

0.37 

0.08 

0.79 

-0.10 

30186 

D 

0 

7 

13 

-0.19 

0.20 

0.50 

-0.38 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30187 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

30187 

A 

1 

27 

47 

1.62 

0.20 

0.81 

0.57 

30187 

B 

0 

1 

2 

1.20 

0.00 

1.39 

0.04 

30187 

C 

0 

14 

25 

0.24 

0.24 

0.76 

-0.19 

30187 

D 

0 

15 

26 

-0.42 

0.44 

0.56 

-0.47 

30188 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.03 

30188 

A 

1 

49 

84 

0.98 

0.16 

0.97 

0.34 

30188 

B 

0 

4 

7 

0.09 

0.21 

0.72 

-0.18 

30188 

C 

0 

3 

5 

-0.36 

0.67 

0.60 

-0.25 

30188 

D 

0 

2 

3 

0.15 

0.46 

0.79 

-0.12 

30189 

* 

-1 

4928 

99 

1.21 

0.02 

0.00 

0.05 

30189 

A 

1 

30 

45 

1.50 

0.17 

0.67 

0.60 

30189 

B 

0 

2 

3 

-0.14 

0.48 

0.46 

-0.11 

30189 

C 

0 

14 

21 

-0.31 

0.30 

0.63 

-0.39 

30189 

D 

0 

20 

30 

0.14 

0.27 

0.86 

-0.26 

30190 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

30190 

A 

1 

49 

86 

0.93 

0.10 

1.02 

0.17 

30190 

B 

0 

1 

2 

-0.03 

0.00 

0.47 

-0.18 

30190 

C 

0 

3 

5 

0.43 

0.34 

0.84 

-0.16 

30190 

D 

0 

4 

7 

0.88 

0.31 

1.34 

0.00 

30191 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

30191 

A 

1 

33 

58 

1.12 

0.18 

1.01 

0.38 

30191 

B 

0 

6 

11 

0.86 

0.20 

1.30 

0.03 

30191 

C 

0 

7 

12 

-0.20 

0.46 

0.80 

-0.35 

30191 

D 

0 

11 

19 

0.33 

0.22 

0.86 

-0.21 

30192 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.02 

30192 

A 

1 

42 

76 

1.19 

0.14 

0.88 

0.44 

30192 

B 

0 

4 

7 

-0.37 

0.39 

0.42 

-0.37 

30192 

C 

0 

2 

4 

1.49 

0.27 

2.24 

0.11 

30192 

D 

0 

7 

13 

0.08 

0.31 

0.70 

-0.33 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30193 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.03 

30193 

A 

1 

32 

55 

1.55 

0.14 

0.65 

0.68 

30193 

B 

0 

5 

9 

-0.56 

0.50 

0.40 

-0.38 

30193 

C 

0 

8 

14 

0.25 

0.27 

0.72 

-0.21 

30193 

D 

0 

13 

22 

0.07 

0.24 

0.63 

-0.37 

30194 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

30194 

A 

1 

40 

70 

1.15 

0.18 

0.96 

0.49 

30194 

B 

0 

3 

5 

-0.27 

0.49 

0.56 

-0.21 

30194 

C 

0 

1 

2 

0.12 

0.00 

0.67 

-0.07 

30194 

D 

0 

13 

23 

-0.09 

0.20 

0.70 

-0.40 

30195 

* 

-1 

4942 

99 

1.21 

0.02 

0.00 

0.01 

30195 

A 

1 

29 

56 

1.50 

0.20 

0.96 

0.46 

30195 

B 

0 

4 

8 

1.02 

0.23 

1.16 

0.00 

30195 

C 

0 

7 

13 

0.59 

0.37 

1.08 

-0.15 

30195 

D 

0 

12 

23 

0.13 

0.30 

0.68 

-0.42 

30196 

* 

-1 

4933 

99 

1.21 

0.02 

0.00 

0.04 

30196 

A 

1 

50 

82 

0.93 

0.16 

1.06 

0.46 

30196 

B 

0 

2 

3 

-0.14 

0.09 

0.66 

-0.12 

30196 

C 

0 

2 

3 

-1.89 

0.01 

0.11 

-0.40 

30196 

D 

0 

7 

11 

-0.20 

0.30 

0.79 

-0.26 

30197 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.02 

30197 

A 

1 

37 

65 

1.45 

0.17 

0.86 

0.53 

30197 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30197 

C 

0 

9 

16 

0.03 

0.25 

0.55 

-0.27 

30197 

D 

0 

11 

19 

-0.22 

0.59 

0.69 

-0.39 

30198 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.06 

30198 

A 

1 

41 

75 

0.71 

0.13 

0.86 

0.48 

30198 

B 

0 

4 

7 

0.48 

0.46 

1.74 

0.01 

30198 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30198 

D 

0 

10 

18 

-0.72 

0.23 

0.49 

-0.55 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30199 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.04 

30199 

A 

1 

31 

56 

0.91 

0.14 

1.15 

0.27 

30199 

B 

0 

2 

4 

0.79 

0.33 

1.15 

0.02 

30199 

C 

0 

10 

18 

0.72 

0.30 

1.44 

0.00 

30199 

D 

0 

12 

22 

0.22 

0.18 

0.75 

-0.33 

30200 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.02 

30200 

A 

1 

47 

85 

1.04 

0.15 

1.04 

0.33 

30200 

B 

0 

2 

4 

-0.15 

0.09 

0.51 

-0.19 

30200 

C 

0 

3 

5 

0.10 

0.00 

0.65 

-0.18 

30200 

D 

0 

3 

5 

0.11 

1.05 

1.95 

-0.17 

30201 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.03 

30201 

A 

1 

48 

91 

0.85 

0.15 

0.97 

0.28 

30201 

B 

0 

4 

8 

-0.29 

0.55 

0.75 

-0.29 

30201 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30201 

D 

0 

1 

2 

0.51 

0.00 

1.14 

-0.03 

30202 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.05 

30202 

A 

1 

39 

71 

0.97 

0.16 

0.91 

0.46 

30202 

B 

0 

12 

22 

0.23 

0.24 

1.14 

-0.17 

30202 

C 

0 

1 

2 

-0.80 

0.00 

0.30 

-0.16 

30202 

D 

0 

3 

5 

-2.01 

0.99 

0.18 

-0.52 

30203 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.02 

30203 

A 

1 

48 

86 

1.10 

0.15 

0.93 

0.43 

30203 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30203 

C 

0 

5 

9 

-0.32 

0.46 

0.64 

-0.36 

30203 

D 

0 

3 

5 

-0.05 

0.15 

0.57 

-0.21 

30204 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

30204 

A 

1 

55 

96 

0.87 

0.14 

1.02 

0.10 

30204 

B 

0 

1 

2 

0.43 

0.00 

0.96 

-0.06 

30204 

C 

0 

1 

2 

0.26 

0.00 

0.81 

-0.08 

30204 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30205 

* 

-1 

4930 

99 

1.21 

0.02 

0.00 

0.05 

30205 

A 

1 

52 

81 

0.86 

0.14 

0.96 

0.43 

30205 

B 

0 

9 

14 

-0.20 

0.25 

0.74 

-0.32 

30205 

C 

0 

1 

2 

-1.90 

0.00 

0.11 

-0.30 

30205 

D 

0 

2 

3 

-0.01 

0.88 

1.00 

-0.11 

30206 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

30206 

A 

1 

49 

86 

0.90 

0.14 

0.91 

0.40 

30206 

B 

0 

4 

7 

-0.19 

0.67 

1.07 

-0.23 

30206 

C 

0 

2 

4 

-0.95 

0.88 

0.38 

-0.30 

30206 

D 

0 

2 

4 

-0.07 

0.67 

0.80 

-0.14 

30207 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.02 

30207 

A 

1 

43 

81 

1.20 

0.16 

1.08 

0.43 

30207 

B 

0 

3 

6 

0.47 

0.69 

1.27 

-0.11 

30207 

C 

0 

4 

8 

-0.34 

0.33 

0.45 

-0.33 

30207 

D 

0 

3 

6 

-0.10 

0.26 

0.52 

-0.24 

30208 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30208 

A 

1 

38 

68 

1.37 

0.14 

0.70 

0.68 

30208 

B 

0 

3 

5 

0.28 

0.45 

0.87 

-0.12 

30208 

C 

0 

12 

21 

-0.33 

0.26 

0.61 

-0.53 

30208 

D 

0 

3 

5 

-0.71 

0.27 

0.28 

-0.32 

30209 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.05 

30209 

A 

1 

40 

69 

0.83 

0.16 

1.28 

0.33 

30209 

B 

0 

1 

2 

-0.05 

0.00 

0.62 

-0.07 

30209 

C 

0 

14 

24 

0.44 

0.22 

1.31 

-0.06 

30209 

D 

0 

3 

5 

-2.12 

0.89 

0.14 

-0.53 

30210 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.03 

30210 

A 

1 

41 

75 

1.12 

0.17 

1.06 

0.44 

30210 

B 

0 

10 

18 

0.11 

0.36 

1.13 

-0.29 

30210 

C 

0 

1 

2 

-1.44 

0.00 

0.14 

-0.26 

30210 

D 

0 

3 

5 

-0.19 

0.46 

0.59 

-0.21 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30211 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.05 

30211 

A 

1 

50 

91 

0.81 

0.16 

0.84 

0.59 

30211 

B 

0 

1 

2 

-0.69 

0.00 

0.52 

-0.11 

30211 

C 

0 

1 

2 

-1.08 

0.00 

0.35 

-0.14 

30211 

D 

0 

3 

5 

-3.40 

1.58 

0.34 

-0.60 

30212 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30212 

A 

1 

54 

96 

0.83 

0.16 

0.98 

0.25 

30212 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30212 

C 

0 

1 

2 

-1.09 

0.00 

0.27 

-0.21 

30212 

D 

0 

1 

2 

-0.48 

0.00 

0.50 

-0.14 

30213 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.05 

30213 

A 

1 

53 

96 

0.58 

0.14 

0.96 

0.32 

30213 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30213 

C 

0 

1 

2 

-0.89 

0.00 

0.40 

-0.19 

30213 

D 

0 

1 

2 

-1.44 

0.00 

0.23 

-0.26 

30214 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.05 

30214 

A 

1 

52 

98 

0.63 

0.12 

0.77 

0.50 

30214 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30214 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30214 

D 

0 

1 

2 

-3.04 

0.00 

0.05 

-0.50 

30215 

* 

-1 

4932 

99 

1.21 

0.02 

0.00 

0.03 

30215 

A 

1 

61 

98 

0.83 

0.13 

1.01 

0.16 

30215 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30215 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30215 

D 

0 

1 

2 

-0.51 

0.00 

0.45 

-0.16 

30216 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.03 

30216 

A 

-1 

54 

100 

0.88 

0.14 

0.00 

0.00 

30216 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30216 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30216 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30217 

* 

-1 

4946 

99 

1.21 

0.02 

0.00 

0.03 

30217 

A 

1 

47 

98 

0.90 

0.19 

0.93 

0.26 

30217 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30217 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30217 

D 

0 

1 

2 

-1.60 

0.00 

0.18 

-0.26 

30218 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

30218 

A 

1 

53 

95 

0.78 

0.20 

2.05 

0.13 

30218 

B 

0 

1 

2 

-1.09 

0.00 

0.37 

-0.17 

30218 

C 

0 

1 

2 

-0.13 

0.00 

0.96 

-0.08 

30218 

D 

0 

1 

2 

1.05 

0.00 

3.13 

0.03 

30219 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.02 

30219 

A 

1 

51 

91 

1.14 

0.15 

0.87 

0.52 

30219 

B 

0 

4 

7 

-0.71 

0.47 

0.47 

-0.36 

30219 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30219 

D 

0 

1 

2 

-3.04 

0.00 

0.03 

-0.42 

30220 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

30220 

A 

1 

54 

95 

0.92 

0.14 

0.78 

0.52 

30220 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30220 

C 

0 

1 

2 

-0.68 

0.00 

0.45 

-0.17 

30220 

D 

0 

2 

4 

-2.31 

0.36 

0.09 

-0.51 

30221 

* 

-1 

4946 

99 

1.21 

0.02 

0.00 

0.02 

30221 

A 

1 

8 

17 

1.94 

0.56 

1.15 

0.35 

30221 

B 

0 

25 

52 

1.09 

0.19 

1.22 

0.08 

30221 

C 

0 

6 

13 

0.55 

0.58 

0.79 

-0.14 

30221 

D 

0 

9 

19 

0.17 

0.32 

0.50 

-0.32 

30222 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.02 

30222 

A 

1 

12 

22 

1.98 

0.40 

0.90 

0.46 

30222 

B 

0 

23 

43 

0.84 

0.16 

1.03 

-0.04 

30222 

C 

0 

13 

24 

0.49 

0.39 

1.22 

-0.18 

30222 

D 

0 

6 

11 

-0.23 

0.38 

0.36 

-0.31 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30223 

* 

-1 

4936 

99 

1.22 

0.02 

0.00 

0.07 

30223 

A 

1 

31 

53 

0.78 

0.18 

1.04 

0.39 

30223 

B 

0 

7 

12 

-0.26 

0.42 

0.88 

-0.20 

30223 

C 

0 

12 

21 

-0.11 

0.35 

1.13 

-0.21 

30223 

D 

0 

8 

14 

-0.01 

0.45 

1.19 

-0.13 

30224 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.03 

30224 

A 

1 

8 

14 

2.16 

0.54 

0.92 

0.44 

30224 

B 

0 

39 

67 

0.76 

0.16 

0.92 

-0.11 

30224 

C 

0 

4 

7 

0.10 

0.62 

0.50 

-0.17 

30224 

D 

0 

7 

12 

0.30 

0.45 

0.63 

-0.17 

30225 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.05 

30225 

A 

1 

28 

50 

1.01 

0.14 

0.94 

0.35 

30225 

B 

0 

13 

23 

0.48 

0.30 

1.41 

-0.07 

30225 

C 

0 

8 

14 

0.61 

0.37 

1.57 

-0.01 

30225 

D 

0 

7 

13 

-0.61 

0.57 

0.50 

-0.43 

30226 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.05 

30226 

A 

1 

10 

17 

0.54 

0.43 

3.14 

-0.05 

30226 

B 

0 

10 

17 

0.37 

0.33 

0.94 

-0.14 

30226 

C 

0 

32 

55 

0.81 

0.14 

1.23 

0.20 

30226 

D 

0 

6 

10 

0.36 

0.16 

0.63 

-0.10 

30227 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.05 

30227 

A 

1 

8 

15 

1.35 

0.73 

1.94 

0.30 

30227 

B 

0 

26 

48 

0.59 

0.17 

1.15 

0.05 

30227 

C 

0 

7 

13 

-0.02 

0.38 

0.67 

-0.19 

30227 

D 

0 

13 

24 

0.21 

0.16 

0.69 

-0.16 

30228 

* 

-1 

4702 

94 

1.17 

0.02 

0.00 

-0.11 

30228 

A 

1 

158 

54 

2.49 

0.09 

0.84 

0.57 

30228 

B 

0 

60 

21 

1.11 

0.12 

0.81 

-0.27 

30228 

C 

0 

62 

21 

1.00 

0.12 

0.72 

-0.32 

30228 

D 

0 

12 

4 

0.38 

0.23 

0.36 

-0.23 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30229 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.05 

30229 

A 

1 

13 

22 

1.06 

0.41 

1.87 

0.26 

30229 

B 

0 

8 

14 

0.66 

0.26 

1.04 

0.04 

30229 

C 

0 

29 

49 

0.38 

0.17 

1.00 

-0.18 

30229 

D 

0 

9 

15 

0.35 

0.21 

0.76 

-0.09 

30230 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.05 

30230 

A 

1 

25 

45 

0.96 

0.27 

1.22 

0.27 

30230 

B 

0 

8 

15 

0.16 

0.37 

1.01 

-0.12 

30230 

C 

0 

9 

16 

1.08 

0.42 

2.91 

0.17 

30230 

D 

0 

13 

24 

-0.34 

0.35 

0.77 

-0.36 

30231 

* 

-1 

4942 

99 

1.21 

0.02 

0.00 

0.02 

30231 

A 

1 

7 

13 

1.54 

0.37 

1.19 

0.24 

30231 

B 

0 

4 

8 

0.03 

0.77 

0.81 

-0.27 

30231 

C 

0 

39 

75 

0.92 

0.14 

1.03 

-0.06 

30231 

D 

0 

2 

4 

1.39 

0.74 

1.47 

0.09 

30232 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.06 

30232 

A 

1 

46 

82 

0.60 

0.16 

1.01 

0.35 

30232 

B 

0 

2 

4 

-0.74 

0.89 

0.61 

-0.21 

30232 

C 

0 

3 

5 

0.39 

0.35 

1.47 

-0.01 

30232 

D 

0 

5 

9 

-0.66 

0.17 

0.49 

-0.32 

30233 

* 

-1 

4942 

99 

1.21 

0.02 

0.00 

0.03 

30233 

A 

1 

39 

75 

1.17 

0.16 

0.81 

0.50 

30233 

B 

0 

5 

10 

0.02 

0.70 

1.23 

-0.19 

30233 

C 

0 

4 

8 

0.13 

0.71 

1.50 

-0.15 

30233 

D 

0 

4 

8 

-1.24 

0.78 

0.31 

-0.45 

30234 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

30234 

A 

1 

6 

11 

1.78 

0.63 

1.71 

0.36 

30234 

B 

0 

4 

7 

0.77 

0.79 

1.24 

0.03 

30234 

C 

0 

39 

70 

0.55 

0.14 

0.83 

-0.16 

30234 

D 

0 

7 

13 

0.31 

0.46 

0.79 

-0.13 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30235 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

30235 

A 

1 

29 

51 

1.32 

0.17 

1.07 

0.39 

30235 

B 

0 

3 

5 

-0.06 

0.45 

0.43 

-0.17 

30235 

C 

0 

21 

37 

0.62 

0.15 

0.89 

-0.14 

30235 

D 

0 

4 

7 

-0.76 

1.68 

1.11 

-0.35 

30236 

* 

-1 

4933 

99 

1.21 

0.02 

0.00 

0.06 

30236 

A 

1 

49 

80 

0.76 

0.14 

0.85 

0.45 

30236 

B 

0 

8 

13 

-0.94 

0.25 

0.38 

-0.53 

30236 

C 

0 

3 

5 

0.47 

0.60 

1.76 

-0.01 

30236 

D 

0 

1 

2 

0.80 

0.00 

1.77 

0.03 

30237 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.03 

30237 

A 

1 

38 

70 

1.02 

0.15 

1.12 

0.24 

30237 

B 

0 

2 

4 

0.46 

0.91 

1.12 

-0.08 

30237 

C 

0 

7 

13 

1.07 

0.24 

1.71 

0.08 

30237 

D 

0 

7 

13 

-0.05 

0.45 

0.80 

-0.36 

30238 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.04 

30238 

A 

1 

45 

85 

0.88 

0.17 

1.07 

0.27 

30238 

B 

0 

1 

2 

-0.34 

0.00 

0.50 

-0.13 

30238 

C 

0 

3 

6 

0.75 

0.59 

2.19 

0.00 

30238 

D 

0 

4 

8 

-0.45 

0.42 

0.62 

-0.30 

30239 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.02 

30239 

A 

1 

49 

83 

1.03 

0.17 

1.16 

0.23 

30239 

B 

0 

7 

12 

-0.15 

0.29 

0.72 

-0.32 

30239 

C 

0 

2 

3 

2.09 

0.19 

5.11 

0.19 

30239 

D 

0 

1 

2 

-0.20 

0.00 

0.50 

-0.12 

30240 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.05 

30240 

A 

1 

48 

81 

0.85 

0.17 

1.06 

0.35 

30240 

B 

0 

5 

8 

-0.13 

0.29 

0.80 

-0.20 

30240 

C 

0 

4 

7 

-0.52 

0.38 

0.53 

-0.27 

30240 

D 

0 

2 

3 

0.20 

0.09 

0.92 

-0.07 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30241 

* 

-1 

4933 

99 

1.21 

0.02 

0.00 

0.03 

30241 

A 

1 

37 

61 

1.21 

0.15 

0.93 

0.47 

30241 

B 

0 

3 

5 

-0.80 

0.56 

0.30 

-0.34 

30241 

C 

0 

12 

20 

0.85 

0.22 

1.38 

0.02 

30241 

D 

0 

9 

15 

-0.34 

0.29 

0.47 

-0.45 

30242 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30242 

A 

1 

37 

66 

1.09 

0.19 

1.17 

0.35 

30242 

B 

0 

2 

4 

-0.23 

0.51 

0.49 

-0.17 

30242 

C 

0 

8 

14 

0.93 

0.31 

1.92 

0.05 

30242 

D 

0 

9 

16 

-0.32 

0.28 

0.50 

-0.42 

30243 

* 

-1 

4943 

99 

1.21 

0.02 

0.00 

0.05 

30243 

A 

1 

18 

35 

1.27 

0.28 

1.04 

0.42 

30243 

B 

0 

10 

20 

0.62 

0.40 

1.80 

0.01 

30243 

C 

0 

8 

16 

0.45 

0.38 

1.33 

-0.06 

30243 

D 

0 

15 

29 

-0.12 

0.19 

0.54 

-0.40 

30244 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

30244 

A 

1 

36 

63 

0.91 

0.15 

1.06 

0.38 

30244 

B 

0 

4 

7 

-0.44 

0.10 

0.37 

-0.34 

30244 

C 

0 

8 

14 

0.57 

0.26 

1.30 

-0.04 

30244 

D 

0 

9 

16 

0.18 

0.19 

0.79 

-0.23 

30245 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

30245 

A 

1 

18 

32 

1.42 

0.25 

1.06 

0.43 

30245 

B 

0 

8 

14 

-0.25 

0.26 

0.38 

-0.35 

30245 

C 

0 

15 

27 

0.66 

0.31 

1.32 

-0.03 

30245 

D 

0 

15 

27 

0.44 

0.23 

0.87 

-0.15 

30246 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30246 

A 

1 

30 

54 

1.07 

0.23 

1.21 

0.25 

30246 

B 

0 

15 

27 

0.84 

0.26 

1.77 

0.02 

30246 

C 

0 

3 

5 

0.18 

0.18 

0.62 

-0.13 

30246 

D 

0 

8 

14 

-0.05 

0.37 

0.74 

-0.29 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30247 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.04 

30247 

A 

1 

32 

58 

1.18 

0.16 

1.05 

0.49 

30247 

B 

0 

5 

9 

-0.47 

0.32 

0.38 

-0.31 

30247 

C 

0 

6 

11 

0.37 

0.34 

0.90 

-0.10 

30247 

D 

0 

12 

22 

0.05 

0.45 

0.89 

-0.29 

30248 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.05 

30248 

A 

1 

32 

56 

0.71 

0.14 

1.20 

0.12 

30248 

B 

0 

13 

23 

0.57 

0.30 

1.66 

-0.03 

30248 

C 

0 

8 

14 

0.74 

0.28 

1.56 

0.05 

30248 

D 

0 

4 

7 

-0.17 

0.38 

0.58 

-0.25 

30249 

* 

-1 

4946 

99 

1.21 

0.02 

0.00 

0.03 

30249 

A 

1 

29 

60 

1.23 

0.17 

0.76 

0.60 

30249 

B 

0 

7 

15 

0.13 

0.27 

0.76 

-0.24 

30249 

C 

0 

3 

6 

0.36 

0.55 

1.00 

-0.09 

30249 

D 

0 

9 

19 

-0.29 

0.20 

0.47 

-0.48 

30250 

* 

-1 

4945 

99 

1.21 

0.02 

0.00 

0.04 

30250 

A 

1 

34 

69 

1.06 

0.15 

0.79 

0.52 

30250 

B 

0 

2 

4 

-0.17 

0.08 

0.51 

-0.17 

30250 

C 

0 

3 

6 

0.11 

0.49 

0.85 

-0.14 

30250 

D 

0 

10 

20 

-0.18 

0.36 

1.00 

-0.42 

30251 

* 

-1 

4959 

99 

1.21 

0.02 

0.00 

0.03 

30251 

A 

1 

33 

94 

0.78 

0.15 

0.81 

0.54 

30251 

B 

0 

2 

6 

-1.50 

0.06 

0.18 

-0.54 

30251 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30251 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30252 

* 

-1 

4947 

99 

1.21 

0.02 

0.00 

0.01 

30252 

A 

1 

42 

89 

1.11 

0.17 

1.05 

0.22 

30252 

B 

0 

1 

2 

-0.99 

0.00 

0.21 

-0.27 

30252 

C 

0 

4 

9 

0.64 

0.42 

1.34 

-0.10 

30252 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30253 

* 

-1 

4953 

99 

1.21 

0.02 

0.00 

0.03 

30253 

A 

-1 

41 

100 

0.70 

0.15 

0.00 

0.00 

30253 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30253 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30253 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30254 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.03 

30254 

A 

1 

51 

94 

0.91 

0.12 

0.79 

0.55 

30254 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30254 

C 

0 

2 

4 

-1.40 

0.04 

0.17 

-0.45 

30254 

D 

0 

1 

2 

-1.38 

0.00 

0.17 

-0.31 

30255 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.03 

30255 

A 

1 

53 

98 

0.81 

0.18 

0.97 

0.24 

30255 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30255 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30255 

D 

0 

1 

2 

-1.60 

0.00 

0.20 

-0.24 

30256 

* 

-1 

4952 

99 

1.21 

0.02 

0.00 

0.02 

30256 

A 

1 

41 

98 

0.85 

0.22 

1.03 

-0.01 

30256 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30256 

C 

0 

1 

2 

0.90 

0.00 

1.85 

0.01 

30256 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30257 

* 

-1 

4958 

99 

1.21 

0.02 

0.00 

0.02 

30257 

A 

1 

28 

78 

0.99 

0.18 

1.30 

0.14 

30257 

B 

0 

8 

22 

0.70 

0.20 

1.11 

-0.14 

30257 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30257 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30258 

* 

-1 

4947 

99 

1.21 

0.02 

0.00 

0.03 

30258 

A 

1 

45 

96 

0.89 

0.17 

0.99 

0.20 

30258 

B 

0 

1 

2 

0.07 

0.00 

0.73 

-0.10 

30258 

C 

0 

1 

2 

-0.59 

0.00 

0.38 

-0.19 

30258 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30259 

* 

-1 

4949 

99 

1.21 

0.02 

0.00 

0.04 

30259 

A 

1 

43 

96 

0.81 

0.16 

1.06 

0.34 

30259 

B 

0 

1 

2 

2.61 

0.00 

10.10 

0.20 

30259 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30259 

D 

0 

1 

2 

-5.70 

0.00 

0.00 

-0.68 

30260 

* 

-1 

4948 

99 

1.21 

0.02 

0.00 

0.05 

30260 

A 

-1 

45 

98 

0.65 

0.15 

0.00 

0.69 

30260 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30260 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30260 

D 

-1 

1 

2 

-5.70 

0.00 

0.00 

-0.69 

30261 

* 

-1 

4949 

99 

1.21 

0.02 

0.00 

0.05 

30261 

A 

-1 

44 

98 

0.62 

0.14 

0.00 

0.74 

30261 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30261 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30261 

D 

-1 

1 

2 

-5.89 

0.00 

0.00 

-0.74 

30262 

* 

-1 

4956 

99 

1.21 

0.02 

0.00 

0.03 

30262 

A 

1 

37 

97 

0.72 

0.17 

1.04 

0.25 

30262 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30262 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30262 

D 

0 

1 

3 

-0.90 

0.00 

0.36 

-0.25 

30263 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.03 

30263 

A 

1 

49 

91 

0.86 

0.17 

1.04 

0.23 

30263 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30263 

C 

0 

1 

2 

-1.56 

0.00 

0.16 

-0.26 

30263 

D 

0 

4 

7 

0.25 

0.38 

1.19 

-0.12 

30264 

* 

-1 

4952 

99 

1.21 

0.02 

0.00 

0.02 

30264 

A 

-1 

42 

100 

0.93 

0.16 

0.00 

0.00 

30264 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30264 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30264 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

easyCBM  CCSS  Third  Grade  Math  Measure  Development 


271 

Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30265 

* 

-1 

4956 

99 

1.21 

0.02 

0.00 

0.03 

30265 

A 

-1 

38 

100 

0.80 

0.13 

0.00 

0.00 

30265 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30265 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30265 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30266 

* 

-1 

4953 

99 

1.21 

0.02 

0.00 

0.01 

30266 

A 

-1 

41 

100 

1.04 

0.16 

0.00 

0.00 

30266 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30266 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30266 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30267 

* 

-1 

4958 

99 

1.21 

0.02 

0.00 

0.03 

30267 

A 

1 

34 

94 

0.72 

0.18 

1.12 

0.00 

30267 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30267 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30267 

D 

0 

2 

6 

0.73 

0.25 

1.56 

0.00 

30268 

* 

-1 

4946 

99 

1.21 

0.02 

0.00 

0.02 

30268 

A 

1 

45 

94 

1.03 

0.15 

0.88 

0.42 

30268 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30268 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30268 

D 

0 

3 

6 

-0.84 

0.42 

0.32 

-0.42 

30269 

* 

-1 

4954 

99 

1.21 

0.02 

0.00 

0.04 

30269 

A 

1 

35 

88 

0.78 

0.12 

0.86 

0.43 

30269 

B 

0 

4 

10 

-0.04 

0.62 

0.96 

-0.26 

30269 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30269 

D 

0 

1 

3 

-1.60 

0.00 

0.14 

-0.41 

30270 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.05 

30270 

A 

1 

47 

87 

0.83 

0.16 

0.77 

0.55 

30270 

B 

0 

4 

7 

-0.53 

0.13 

0.56 

-0.25 

30270 

C 

0 

2 

4 

-1.48 

0.16 

0.21 

-0.32 

30270 

D 

0 

1 

2 

-3.48 

0.00 

0.03 

-0.44 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30271 

* 

-1 

4955 

99 

1.21 

0.02 

0.00 

0.02 

30271 

A 

-1 

39 

100 

0.84 

0.19 

0.00 

0.00 

30271 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30271 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30271 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30272 

* 

-1 

4948 

99 

1.21 

0.02 

0.00 

0.02 

30272 

A 

1 

45 

98 

0.95 

0.14 

0.98 

0.23 

30272 

B 

0 

1 

2 

-0.57 

0.00 

0.34 

-0.23 

30272 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30272 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30273 

* 

-1 

4944 

99 

1.21 

0.02 

0.00 

0.05 

30273 

A 

1 

49 

98 

0.60 

0.16 

1.07 

0.11 

30273 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30273 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30273 

D 

0 

1 

2 

-0.23 

0.00 

0.84 

-0.11 

30274 

* 

-1 

4951 

99 

1.21 

0.02 

0.00 

0.03 

30274 

A 

-1 

43 

100 

0.83 

0.14 

0.00 

0.00 

30274 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30274 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30274 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30275 

* 

-1 

4950 

99 

1.21 

0.02 

0.00 

0.03 

30275 

A 

1 

29 

66 

1.02 

0.18 

1.08 

0.34 

30275 

B 

0 

6 

14 

0.64 

0.27 

1.18 

-0.05 

30275 

C 

0 

6 

14 

0.30 

0.37 

0.99 

-0.19 

30275 

D 

0 

3 

7 

-0.37 

0.81 

0.66 

-0.31 

30276 

* 

-1 

4953 

99 

1.21 

0.02 

0.00 

0.04 

30276 

A 

1 

37 

90 

0.72 

0.14 

0.80 

0.49 

30276 

B 

0 

1 

2 

-1.05 

0.00 

0.31 

-0.24 

30276 

C 

0 

1 

2 

-2.19 

0.00 

0.10 

-0.42 

30276 

D 

0 

2 

5 

-0.34 

1.34 

1.28 

-0.20 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30277 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

30277 

A 

1 

53 

93 

0.74 

0.14 

0.95 

0.32 

30277 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30277 

C 

0 

2 

4 

-0.80 

0.82 

0.50 

-0.27 

30277 

D 

0 

2 

4 

-0.30 

0.96 

0.91 

-0.17 

30278 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

30278 

A 

1 

55 

96 

0.83 

0.14 

1.02 

0.02 

30278 

B 

0 

1 

2 

2.21 

0.00 

6.24 

0.17 

30278 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30278 

D 

0 

1 

2 

-0.75 

0.00 

0.33 

-0.20 

30279 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.03 

30279 

A 

1 

53 

96 

0.96 

0.11 

0.88 

0.42 

30279 

B 

0 

1 

2 

-0.32 

0.00 

0.43 

-0.19 

30279 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30279 

D 

0 

1 

2 

-1.69 

0.00 

0.11 

-0.40 

30280 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.05 

30280 

A 

1 

56 

98 

0.55 

0.13 

1.03 

-0.01 

30280 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30280 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30280 

D 

0 

1 

2 

0.60 

0.00 

1.57 

0.01 

30281 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

30281 

A 

1 

54 

95 

0.91 

0.12 

0.78 

0.49 

30281 

B 

0 

3 

5 

-1.26 

0.87 

0.45 

-0.49 

30281 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30281 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30282 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.02 

30282 

A 

1 

57 

98 

0.96 

0.12 

1.03 

-0.16 

30282 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30282 

C 

0 

1 

2 

2.06 

0.00 

4.42 

0.16 

30282 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30283 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

30283 

A 

1 

54 

95 

0.88 

0.14 

0.91 

0.39 

30283 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30283 

C 

0 

2 

4 

-1.51 

0.13 

0.18 

-0.39 

30283 

D 

0 

1 

2 

-0.17 

0.00 

0.67 

-0.11 

30284 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

30284 

A 

1 

55 

96 

0.87 

0.13 

1.00 

0.20 

30284 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30284 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30284 

D 

0 

2 

4 

-0.20 

0.05 

0.52 

-0.20 

30285 

* 

-1 

4945 

99 

1.21 

0.02 

0.00 

0.05 

30285 

A 

1 

46 

94 

0.67 

0.13 

1.00 

0.32 

30285 

B 

0 

1 

2 

-0.05 

0.00 

0.76 

-0.10 

30285 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30285 

D 

0 

2 

4 

-0.80 

0.17 

0.37 

-0.31 

30286 

* 

-1 

4932 

99 

1.21 

0.02 

0.00 

0.04 

30286 

A 

1 

60 

97 

0.84 

0.12 

0.84 

0.40 

30286 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30286 

C 

0 

2 

3 

-1.46 

0.92 

0.25 

-0.40 

30286 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30287 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.05 

30287 

A 

1 

54 

98 

0.56 

0.15 

1.05 

0.10 

30287 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30287 

C 

0 

1 

2 

-0.20 

0.00 

0.91 

-0.10 

30287 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30288 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.04 

30288 

A 

1 

55 

92 

0.74 

0.17 

1.09 

0.10 

30288 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30288 

C 

0 

1 

2 

-1.90 

0.00 

0.13 

-0.27 

30288 

D 

0 

4 

7 

0.85 

0.50 

2.83 

0.03 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30289 

* 

-1 

4942 

99 

1.21 

0.02 

0.00 

0.01 

30289 

A 

1 

44 

85 

1.21 

0.14 

0.94 

0.38 

30289 

B 

0 

3 

6 

-0.01 

0.41 

0.54 

-0.27 

30289 

C 

0 

2 

4 

-0.17 

0.17 

0.40 

-0.25 

30289 

D 

0 

3 

6 

0.60 

0.83 

1.51 

-0.12 

30290 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.02 

30290 

A 

1 

43 

81 

1.16 

0.14 

0.98 

0.35 

30290 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30290 

C 

0 

5 

9 

0.68 

0.43 

1.27 

-0.11 

30290 

D 

0 

5 

9 

-0.08 

0.14 

0.46 

-0.36 

30291 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.04 

30291 

A 

1 

46 

78 

0.89 

0.14 

0.95 

0.41 

30291 

B 

0 

7 

12 

0.20 

0.37 

1.15 

-0.16 

30291 

C 

0 

5 

8 

-0.73 

0.49 

0.54 

-0.41 

30291 

D 

0 

1 

2 

0.44 

0.00 

1.04 

-0.03 

30292 

* 

-1 

4928 

99 

1.21 

0.02 

0.00 

0.04 

30292 

A 

1 

7 

11 

0.43 

0.27 

2.34 

-0.13 

30292 

B 

0 

22 

33 

0.74 

0.20 

1.05 

-0.04 

30292 

C 

0 

10 

15 

1.22 

0.27 

1.54 

0.20 

30292 

D 

0 

27 

41 

0.77 

0.18 

1.06 

-0.02 

30293 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.03 

30293 

A 

1 

6 

11 

1.50 

0.65 

2.35 

0.20 

30293 

B 

0 

14 

26 

0.76 

0.32 

1.00 

-0.03 

30293 

C 

0 

9 

17 

0.69 

0.44 

1.00 

-0.05 

30293 

D 

0 

24 

45 

0.73 

0.22 

1.37 

-0.07 

30294 

* 

-1 

4932 

99 

1.21 

0.02 

0.00 

0.04 

30294 

A 

1 

22 

35 

1.06 

0.28 

1.90 

0.24 

30294 

B 

0 

14 

23 

0.35 

0.26 

0.87 

-0.19 

30294 

C 

0 

5 

8 

0.99 

0.41 

1.59 

0.08 

30294 

D 

0 

21 

34 

0.54 

0.18 

1.04 

-0.12 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30295 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.05 

30295 

A 

1 

7 

13 

0.89 

0.43 

1.65 

0.14 

30295 

B 

0 

8 

15 

0.69 

0.53 

2.48 

0.06 

30295 

C 

0 

26 

48 

0.58 

0.16 

1.00 

0.03 

30295 

D 

0 

13 

24 

0.20 

0.21 

0.68 

-0.20 

30296 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.04 

30296 

A 

1 

28 

47 

1.18 

0.19 

1.00 

0.38 

30296 

B 

0 

19 

32 

0.61 

0.26 

1.61 

-0.08 

30296 

C 

0 

9 

15 

-0.16 

0.33 

0.56 

-0.35 

30296 

D 

0 

4 

7 

0.26 

0.12 

0.62 

-0.12 

30297 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.05 

30297 

A 

1 

35 

65 

0.97 

0.24 

0.99 

0.36 

30297 

B 

0 

1 

2 

0.35 

0.00 

1.02 

-0.02 

30297 

C 

0 

8 

15 

0.34 

0.35 

1.63 

-0.07 

30297 

D 

0 

10 

19 

-0.53 

0.45 

0.76 

-0.37 

30298 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.04 

30298 

A 

1 

36 

60 

0.59 

0.18 

2.89 

-0.10 

30298 

B 

0 

17 

28 

1.00 

0.24 

2.22 

0.19 

30298 

C 

0 

2 

3 

0.16 

0.77 

0.83 

-0.09 

30298 

D 

0 

5 

8 

0.39 

0.48 

1.38 

-0.08 

30299 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.06 

30299 

A 

1 

19 

36 

1.16 

0.34 

1.08 

0.40 

30299 

B 

0 

7 

13 

-0.11 

0.23 

0.63 

-0.15 

30299 

C 

0 

4 

8 

1.35 

0.11 

2.36 

0.19 

30299 

D 

0 

23 

43 

-0.19 

0.26 

0.92 

-0.39 

30300 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.04 

30300 

A 

1 

37 

70 

0.94 

0.13 

0.96 

0.39 

30300 

B 

0 

2 

4 

1.12 

0.37 

1.87 

0.09 

30300 

C 

0 

6 

11 

0.31 

0.48 

1.23 

-0.15 

30300 

D 

0 

8 

15 

-0.20 

0.31 

0.66 

-0.41 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30302 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.02 

30302 

A 

1 

46 

82 

1.16 

0.15 

0.97 

0.37 

30302 

B 

0 

5 

9 

0.02 

0.37 

0.64 

-0.29 

30302 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30302 

D 

0 

5 

9 

0.29 

0.34 

0.87 

-0.21 

30303 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.06 

30303 

A 

1 

41 

73 

0.90 

0.17 

0.79 

0.59 

30303 

B 

0 

2 

4 

-0.31 

0.42 

0.67 

-0.12 

30303 

C 

0 

4 

7 

-1.03 

0.40 

0.37 

-0.34 

30303 

D 

0 

9 

16 

-0.69 

0.27 

0.60 

-0.41 

30304 

* 

-1 

4935 

99 

1.22 

0.02 

0.00 

0.07 

30304 

A 

1 

42 

71 

0.79 

0.14 

0.76 

0.55 

30304 

B 

0 

7 

12 

-0.31 

0.33 

0.81 

-0.21 

30304 

C 

0 

1 

2 

-0.19 

0.00 

0.69 

-0.06 

30304 

D 

0 

9 

15 

-0.99 

0.49 

0.64 

-0.49 

30305 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.04 

30305 

A 

1 

48 

83 

0.92 

0.15 

0.99 

0.40 

30305 

B 

0 

4 

7 

0.14 

0.30 

0.89 

-0.15 

30305 

C 

0 

1 

2 

-0.20 

0.00 

0.55 

-0.11 

30305 

D 

0 

5 

9 

-0.47 

0.40 

0.55 

-0.35 

30306 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

30306 

A 

1 

43 

75 

1.06 

0.12 

1.00 

0.41 

30306 

B 

0 

5 

9 

0.39 

0.47 

1.10 

-0.16 

30306 

C 

0 

4 

7 

0.28 

0.39 

0.80 

-0.17 

30306 

D 

0 

5 

9 

-0.04 

0.47 

0.82 

-0.31 

30307 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.02 

30307 

A 

1 

42 

74 

1.14 

0.19 

1.01 

0.30 

30307 

B 

0 

13 

23 

0.38 

0.35 

1.89 

-0.23 

30307 

C 

0 

2 

4 

-0.35 

0.25 

0.41 

-0.19 

30307 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30308 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.02 

30308 

A 

1 

41 

77 

1.13 

0.17 

1.05 

0.25 

30308 

B 

0 

7 

13 

0.59 

0.48 

1.69 

-0.14 

30308 

C 

0 

2 

4 

0.29 

0.92 

0.99 

-0.12 

30308 

D 

0 

3 

6 

0.33 

0.25 

0.75 

-0.14 

30309 

* 

-1 

4952 

99 

1.21 

0.02 

0.00 

0.03 

30309 

A 

1 

38 

90 

0.85 

0.16 

0.94 

0.34 

30309 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30309 

C 

0 

4 

10 

-0.37 

0.68 

0.88 

-0.34 

30309 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30310 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30310 

A 

1 

41 

73 

1.20 

0.16 

0.93 

0.49 

30310 

B 

0 

2 

4 

-0.04 

0.19 

0.52 

-0.16 

30310 

C 

0 

8 

14 

0.34 

0.21 

0.87 

-0.20 

30310 

D 

0 

5 

9 

-0.54 

0.35 

0.41 

-0.41 

30311 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

30311 

A 

1 

44 

77 

0.94 

0.16 

1.06 

0.36 

30311 

B 

0 

2 

4 

0.30 

0.04 

0.83 

-0.08 

30311 

C 

0 

8 

14 

0.05 

0.20 

0.72 

-0.28 

30311 

D 

0 

3 

5 

-0.02 

0.27 

0.64 

-0.18 

30312 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.05 

30312 

A 

1 

43 

75 

1.05 

0.20 

0.84 

0.51 

30312 

B 

0 

4 

7 

-0.92 

0.14 

0.34 

-0.26 

30312 

C 

0 

3 

5 

0.90 

0.08 

2.07 

0.05 

30312 

D 

0 

7 

12 

-1.48 

0.69 

0.49 

-0.49 

30313 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.01 

30313 

A 

1 

39 

68 

1.29 

0.18 

1.41 

0.30 

30313 

B 

0 

4 

7 

0.38 

0.58 

1.02 

-0.17 

30313 

C 

0 

13 

23 

0.53 

0.27 

1.02 

-0.26 

30313 

D 

0 

1 

2 

1.98 

0.00 

2.97 

0.11 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30314 

* 

-1 

4938 

99 

1.22 

0.02 

0.00 

0.07 

30314 

A 

1 

44 

79 

0.58 

0.12 

0.86 

0.45 

30314 

B 

0 

5 

9 

-0.02 

0.62 

1.71 

-0.12 

30314 

C 

0 

5 

9 

-0.52 

0.11 

0.54 

-0.29 

30314 

D 

0 

2 

4 

-1.45 

0.37 

0.22 

-0.37 

30315 

* 

-1 

4942 

99 

1.21 

0.02 

0.00 

0.04 

30315 

A 

1 

37 

71 

1.01 

0.16 

0.85 

0.49 

30315 

B 

0 

5 

10 

0.35 

0.32 

1.11 

-0.08 

30315 

C 

0 

1 

2 

-0.20 

0.00 

0.54 

-0.10 

30315 

D 

0 

9 

17 

-0.58 

0.40 

0.66 

-0.49 

30316 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

30316 

A 

1 

42 

74 

1.03 

0.18 

1.37 

0.47 

30316 

B 

0 

6 

11 

-0.52 

0.40 

0.51 

-0.32 

30316 

C 

0 

3 

5 

-0.61 

0.51 

0.45 

-0.24 

30316 

D 

0 

6 

11 

0.01 

0.39 

0.99 

-0.18 

30317 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.05 

30317 

A 

1 

47 

80 

0.80 

0.16 

1.13 

0.30 

30317 

B 

0 

9 

15 

-0.14 

0.49 

1.30 

-0.27 

30317 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30317 

D 

0 

3 

5 

-0.03 

1.00 

1.77 

-0.12 

30318 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.04 

30318 

A 

1 

38 

66 

1.20 

0.15 

0.79 

0.63 

30318 

B 

0 

6 

10 

-0.24 

0.27 

0.57 

-0.26 

30318 

C 

0 

1 

2 

-0.24 

0.00 

0.47 

-0.10 

30318 

D 

0 

13 

22 

-0.44 

0.31 

0.56 

-0.50 

30319 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

30319 

A 

1 

45 

79 

1.00 

0.15 

0.90 

0.49 

30319 

B 

0 

5 

9 

-0.20 

0.33 

0.67 

-0.27 

30319 

C 

0 

1 

2 

-0.61 

0.00 

0.36 

-0.17 

30319 

D 

0 

6 

11 

-0.33 

0.39 

0.68 

-0.34 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30320 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.04 

30320 

A 

1 

25 

46 

1.30 

0.27 

1.39 

0.43 

30320 

B 

0 

3 

6 

0.19 

0.43 

0.70 

-0.10 

30320 

C 

0 

3 

6 

0.67 

0.42 

1.08 

-0.01 

30320 

D 

0 

23 

43 

0.18 

0.21 

0.83 

-0.38 

30321 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.05 

30321 

A 

1 

20 

33 

1.20 

0.29 

1.08 

0.41 

30321 

B 

0 

10 

17 

0.32 

0.29 

1.01 

-0.10 

30321 

C 

0 

10 

17 

0.18 

0.36 

1.06 

-0.16 

30321 

D 

0 

20 

33 

0.28 

0.14 

0.84 

-0.19 

30322 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

30322 

A 

1 

12 

21 

1.41 

0.43 

2.38 

0.22 

30322 

B 

0 

8 

14 

1.06 

0.34 

1.22 

0.06 

30322 

C 

0 

10 

18 

1.04 

0.26 

1.01 

0.06 

30322 

D 

0 

27 

47 

0.51 

0.25 

0.89 

-0.27 

30323 

* 

-1 

4946 

99 

1.21 

0.02 

0.00 

0.04 

30323 

A 

1 

15 

31 

1.02 

0.22 

1.26 

0.24 

30323 

B 

0 

10 

21 

0.57 

0.25 

0.96 

-0.06 

30323 

C 

0 

5 

10 

1.28 

0.46 

2.13 

0.22 

30323 

D 

0 

18 

38 

0.30 

0.23 

0.93 

-0.32 

30324 

* 

-1 

4943 

99 

1.22 

0.02 

0.00 

0.07 

30324 

A 

1 

23 

45 

1.06 

0.17 

0.71 

0.55 

30324 

B 

0 

24 

47 

-0.15 

0.20 

0.87 

-0.29 

30324 

C 

0 

2 

4 

0.16 

0.36 

0.83 

-0.02 

30324 

D 

0 

2 

4 

-3.97 

0.49 

0.01 

-0.64 

30325 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.05 

30325 

A 

1 

30 

50 

1.44 

0.23 

0.93 

0.58 

30325 

B 

0 

22 

37 

0.06 

0.22 

0.88 

-0.30 

30325 

C 

0 

2 

3 

-0.32 

0.17 

0.40 

-0.12 

30325 

D 

0 

6 

10 

-1.15 

0.52 

0.30 

-0.41 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30326 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.05 

30326 

A 

1 

33 

56 

0.80 

0.20 

1.46 

0.26 

30326 

B 

0 

4 

7 

0.58 

0.40 

1.27 

0.00 

30326 

C 

0 

1 

2 

0.54 

0.00 

1.01 

-0.01 

30326 

D 

0 

21 

36 

0.24 

0.15 

0.93 

-0.26 

30327 

* 

-1 

4946 

99 

1.21 

0.02 

0.00 

0.03 

30327 

A 

1 

31 

65 

1.12 

0.23 

0.94 

0.42 

30327 

B 

0 

5 

10 

-0.43 

0.44 

0.54 

-0.33 

30327 

C 

0 

1 

2 

1.15 

0.00 

1.90 

0.05 

30327 

D 

0 

11 

23 

0.18 

0.20 

0.86 

-0.25 

30328 

* 

-1 

4945 

99 

1.21 

0.02 

0.00 

0.04 

30328 

A 

1 

24 

49 

1.05 

0.32 

1.59 

0.32 

30328 

B 

0 

5 

10 

0.16 

0.37 

0.87 

-0.11 

30328 

C 

0 

6 

12 

-0.10 

0.51 

0.86 

-0.20 

30328 

D 

0 

14 

29 

0.33 

0.23 

1.11 

-0.13 

30329 

* 

-1 

4695 

94 

1.16 

0.02 

0.00 

-0.14 

30329 

A 

1 

179 

60 

2.47 

0.09 

1.23 

0.48 

30329 

B 

0 

45 

15 

1.50 

0.13 

1.02 

-0.14 

30329 

C 

0 

49 

16 

1.39 

0.13 

1.04 

-0.18 

30329 

D 

0 

26 

9 

0.14 

0.22 

0.31 

-0.42 

30330 

* 

-1 

4943 

99 

1.21 

0.02 

0.00 

0.04 

30330 

A 

1 

8 

16 

1.13 

0.49 

3.21 

0.15 

30330 

B 

0 

9 

18 

0.94 

0.38 

1.49 

0.09 

30330 

C 

0 

8 

16 

0.61 

0.28 

0.77 

-0.03 

30330 

D 

0 

26 

51 

0.53 

0.25 

1.14 

-0.16 

30331 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

30331 

A 

1 

13 

23 

1.06 

0.27 

1.42 

0.16 

30331 

B 

0 

3 

5 

1.07 

0.39 

1.23 

0.07 

30331 

C 

0 

12 

21 

1.15 

0.19 

1.37 

0.19 

30331 

D 

0 

29 

51 

0.44 

0.22 

0.87 

-0.32 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30332 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.04 

30332 

A 

1 

30 

51 

1.19 

0.18 

0.97 

0.47 

30332 

B 

0 

23 

39 

0.25 

0.20 

0.99 

-0.34 

30332 

C 

0 

4 

7 

-0.13 

0.52 

0.58 

-0.22 

30332 

D 

0 

2 

3 

0.29 

0.22 

0.68 

-0.07 

30333 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.03 

30333 

A 

1 

30 

55 

1.62 

0.14 

0.59 

0.68 

30333 

B 

0 

16 

29 

0.24 

0.27 

0.88 

-0.31 

30333 

C 

0 

5 

9 

-0.11 

0.07 

0.39 

-0.24 

30333 

D 

0 

4 

7 

-1.30 

0.66 

0.20 

-0.48 

30334 

* 

-1 

4943 

99 

1.21 

0.02 

0.00 

0.04 

30334 

A 

1 

26 

51 

0.89 

0.24 

1.46 

0.22 

30334 

B 

0 

19 

37 

0.70 

0.20 

1.50 

0.04 

30334 

C 

0 

3 

6 

-0.73 

0.55 

0.33 

-0.30 

30334 

D 

0 

3 

6 

-0.40 

0.50 

0.47 

-0.23 

30335 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.04 

30335 

A 

1 

36 

62 

1.32 

0.19 

0.79 

0.55 

30335 

B 

0 

3 

5 

-0.43 

0.56 

0.45 

-0.22 

30335 

C 

0 

7 

12 

-0.17 

0.40 

0.67 

-0.27 

30335 

D 

0 

12 

21 

-0.01 

0.29 

0.77 

-0.31 

30336 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

30336 

A 

1 

45 

79 

1.33 

0.20 

0.79 

0.53 

30336 

B 

0 

4 

7 

-0.71 

0.42 

0.44 

-0.28 

30336 

C 

0 

1 

2 

-0.75 

0.00 

0.33 

-0.14 

30336 

D 

0 

7 

12 

-0.75 

0.64 

0.64 

-0.39 

30337 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.02 

30337 

A 

1 

29 

54 

1.42 

0.23 

1.02 

0.46 

30337 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30337 

C 

0 

8 

15 

0.62 

0.13 

0.86 

-0.10 

30337 

D 

0 

17 

31 

0.16 

0.24 

0.78 

-0.42 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30338 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.05 

30338 

A 

1 

47 

82 

0.75 

0.15 

1.01 

0.38 

30338 

B 

0 

2 

4 

0.66 

0.30 

1.60 

0.02 

30338 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30338 

D 

0 

8 

14 

-0.60 

0.36 

0.57 

-0.43 

30339 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.01 

30339 

A 

1 

33 

58 

1.39 

0.21 

1.19 

0.33 

30339 

B 

0 

7 

12 

0.94 

0.37 

1.39 

-0.03 

30339 

C 

0 

10 

18 

0.75 

0.29 

1.30 

-0.12 

30339 

D 

0 

7 

12 

0.01 

0.36 

0.56 

-0.33 

30340 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.03 

30340 

A 

1 

52 

87 

1.11 

0.16 

0.91 

0.48 

30340 

B 

0 

2 

3 

-1.18 

0.38 

0.22 

-0.31 

30340 

C 

0 

1 

2 

0.73 

0.00 

1.36 

-0.02 

30340 

D 

0 

5 

8 

-0.64 

0.29 

0.41 

-0.38 

30341 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.04 

30341 

A 

1 

33 

55 

1.23 

0.15 

0.77 

0.53 

30341 

B 

0 

6 

10 

-0.07 

0.44 

0.76 

-0.23 

30341 

C 

0 

14 

23 

0.32 

0.30 

1.24 

-0.18 

30341 

D 

0 

7 

12 

-0.45 

0.29 

0.42 

-0.37 

30342 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.05 

30342 

A 

1 

42 

70 

0.90 

0.14 

0.84 

0.54 

30342 

B 

0 

6 

10 

-0.67 

0.34 

0.45 

-0.40 

30342 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30342 

D 

0 

12 

20 

-0.10 

0.14 

0.70 

-0.32 

30343 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

30343 

A 

1 

32 

57 

1.25 

0.20 

0.87 

0.45 

30343 

B 

0 

5 

9 

0.51 

0.31 

1.04 

-0.07 

30343 

C 

0 

8 

14 

0.39 

0.33 

1.14 

-0.12 

30343 

D 

0 

11 

20 

-0.26 

0.39 

0.63 

-0.41 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30344 

* 

-1 

4933 

99 

1.21 

0.02 

0.00 

0.03 

30344 

A 

1 

50 

82 

1.09 

0.15 

0.96 

0.46 

30344 

B 

0 

4 

7 

-0.13 

0.11 

0.52 

-0.18 

30344 

C 

0 

1 

2 

0.61 

0.00 

1.07 

-0.02 

30344 

D 

0 

6 

10 

-1.07 

1.01 

0.72 

-0.45 

30345 

* 

-1 

4943 

99 

1.21 

0.02 

0.00 

0.05 

30345 

A 

1 

29 

57 

1.02 

0.13 

0.75 

0.56 

30345 

B 

0 

6 

12 

0.40 

0.22 

1.02 

-0.05 

30345 

C 

0 

5 

10 

0.35 

0.50 

1.39 

-0.06 

30345 

D 

0 

11 

22 

-0.60 

0.29 

0.45 

-0.59 

30346 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

30346 

A 

1 

47 

82 

1.10 

0.13 

0.82 

0.55 

30346 

B 

0 

2 

4 

-0.10 

0.07 

0.54 

-0.12 

30346 

C 

0 

2 

4 

0.43 

0.87 

1.27 

-0.04 

30346 

D 

0 

6 

11 

-1.65 

0.98 

0.56 

-0.59 

30347 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.03 

30347 

A 

1 

34 

58 

1.10 

0.18 

1.11 

0.35 

30347 

B 

0 

2 

3 

0.80 

0.34 

1.13 

0.00 

30347 

C 

0 

8 

14 

0.52 

0.23 

0.97 

-0.10 

30347 

D 

0 

15 

25 

0.24 

0.27 

0.84 

-0.32 

30348 

* 

-1 

4942 

99 

1.21 

0.02 

0.00 

0.04 

30348 

A 

1 

40 

77 

0.93 

0.16 

1.01 

0.46 

30348 

B 

0 

2 

4 

0.33 

0.25 

0.98 

-0.05 

30348 

C 

0 

3 

6 

0.29 

0.35 

1.04 

-0.08 

30348 

D 

0 

7 

13 

-0.77 

0.50 

0.55 

-0.49 

30349 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.03 

30349 

A 

1 

30 

55 

1.23 

0.18 

1.04 

0.42 

30349 

B 

0 

2 

4 

1.14 

0.10 

1.43 

0.06 

30349 

C 

0 

8 

15 

0.52 

0.38 

1.13 

-0.09 

30349 

D 

0 

15 

27 

-0.05 

0.34 

0.64 

-0.42 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30350 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

30350 

A 

1 

46 

81 

0.99 

0.13 

1.09 

0.51 

30350 

B 

0 

4 

7 

-0.17 

0.46 

0.71 

-0.22 

30350 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30350 

D 

0 

7 

12 

-0.58 

0.56 

0.60 

-0.44 

30351 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.05 

30351 

A 

1 

23 

40 

0.84 

0.24 

1.53 

0.17 

30351 

B 

0 

28 

49 

0.63 

0.21 

1.58 

0.04 

30351 

C 

0 

1 

2 

-0.78 

0.00 

0.22 

-0.14 

30351 

D 

0 

5 

9 

-0.69 

0.95 

0.97 

-0.31 

30352 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

30352 

A 

1 

25 

44 

1.26 

0.23 

1.05 

0.41 

30352 

B 

0 

4 

7 

-0.52 

0.10 

0.29 

-0.24 

30352 

C 

0 

23 

40 

0.51 

0.24 

1.75 

-0.09 

30352 

D 

0 

5 

9 

-0.82 

0.75 

0.47 

-0.35 

30353 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

30353 

A 

1 

23 

41 

1.20 

0.24 

1.20 

0.32 

30353 

B 

0 

30 

54 

0.61 

0.17 

1.28 

-0.11 

30353 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30353 

D 

0 

3 

5 

-1.67 

1.06 

0.24 

-0.47 

30354 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.03 

30354 

A 

1 

40 

75 

1.05 

0.17 

1.19 

0.35 

30354 

B 

0 

5 

9 

0.33 

0.40 

1.12 

-0.14 

30354 

C 

0 

4 

8 

0.20 

0.27 

0.79 

-0.16 

30354 

D 

0 

4 

8 

-0.20 

0.83 

1.16 

-0.26 

30355 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

30355 

A 

1 

10 

18 

1.13 

0.37 

1.92 

0.14 

30355 

B 

0 

40 

70 

0.90 

0.17 

1.46 

0.19 

30355 

C 

0 

3 

5 

0.11 

0.13 

0.35 

-0.11 

30355 

D 

0 

4 

7 

-1.39 

1.27 

0.77 

-0.44 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30356 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30356 

A 

1 

16 

29 

1.31 

0.39 

1.68 

0.29 

30356 

B 

0 

27 

48 

0.81 

0.15 

1.09 

0.03 

30356 

C 

0 

8 

14 

0.37 

0.40 

0.85 

-0.14 

30356 

D 

0 

5 

9 

-0.52 

0.52 

0.34 

-0.34 

30357 

* 

-1 

4918 

98 

1.21 

0.02 

0.00 

0.04 

30357 

A 

1 

60 

79 

1.07 

0.14 

0.90 

0.45 

30357 

B 

0 

5 

7 

0.52 

0.10 

1.09 

-0.05 

30357 

C 

0 

8 

11 

-0.28 

0.35 

0.74 

-0.29 

30357 

D 

0 

3 

4 

-1.92 

1.46 

0.41 

-0.43 

30358 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

30358 

A 

1 

53 

93 

0.93 

0.16 

0.95 

0.37 

30358 

B 

0 

2 

4 

0.65 

0.82 

1.77 

-0.02 

30358 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30358 

D 

0 

2 

4 

-2.65 

1.10 

0.14 

-0.50 

30359 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30359 

A 

1 

32 

57 

1.26 

0.20 

1.02 

0.42 

30359 

B 

0 

3 

5 

-0.43 

0.34 

0.35 

-0.26 

30359 

C 

0 

10 

18 

0.90 

0.30 

1.74 

0.02 

30359 

D 

0 

11 

20 

-0.12 

0.28 

0.61 

-0.40 

30360 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.04 

30360 

A 

1 

43 

78 

0.86 

0.14 

1.03 

0.20 

30360 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30360 

C 

0 

4 

7 

1.09 

0.33 

1.99 

0.10 

30360 

D 

0 

8 

15 

0.06 

0.27 

0.80 

-0.31 

30361 

* 

-1 

4919 

98 

1.21 

0.02 

0.00 

0.04 

30361 

A 

1 

66 

88 

0.97 

0.12 

0.80 

0.52 

30361 

B 

0 

1 

1 

-0.24 

0.00 

0.60 

-0.09 

30361 

C 

0 

4 

5 

-0.26 

0.38 

0.74 

-0.19 

30361 

D 

0 

4 

5 

-1.88 

0.95 

0.30 

-0.51 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30362 

* 

-1 

4927 

99 

1.21 

0.02 

0.00 

0.02 

30362 

A 

1 

59 

88 

1.12 

0.13 

0.91 

0.41 

30362 

B 

0 

4 

6 

0.37 

0.43 

1.11 

-0.13 

30362 

C 

0 

2 

3 

-0.65 

0.35 

0.33 

-0.25 

30362 

D 

0 

2 

3 

-1.25 

0.86 

0.23 

-0.35 

30363 

* 

-1 

4928 

99 

1.21 

0.02 

0.00 

0.03 

30363 

A 

1 

54 

82 

1.09 

0.16 

1.12 

0.43 

30363 

B 

0 

7 

11 

0.25 

0.18 

0.92 

-0.16 

30363 

C 

0 

1 

2 

-0.73 

0.00 

0.31 

-0.15 

30363 

D 

0 

4 

6 

-1.18 

0.68 

0.34 

-0.40 

30364 

* 

-1 

4947 

99 

1.21 

0.02 

0.00 

0.04 

30364 

A 

1 

37 

79 

0.87 

0.17 

1.02 

0.33 

30364 

B 

0 

8 

17 

0.14 

0.28 

0.94 

-0.25 

30364 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30364 

D 

0 

2 

4 

-0.26 

0.64 

0.60 

-0.20 

30365 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.05 

30365 

A 

1 

36 

65 

1.02 

0.18 

0.87 

0.50 

30365 

B 

0 

13 

24 

0.20 

0.14 

0.86 

-0.20 

30365 

C 

0 

2 

4 

0.18 

0.44 

0.84 

-0.07 

30365 

D 

0 

4 

7 

-1.51 

0.24 

0.15 

-0.53 

30366 

* 

-1 

4930 

99 

1.21 

0.02 

0.00 

0.04 

30366 

A 

1 

54 

84 

1.07 

0.13 

0.68 

0.64 

30366 

B 

0 

5 

8 

-1.12 

0.51 

0.39 

-0.42 

30366 

C 

0 

2 

3 

-0.15 

0.49 

0.74 

-0.12 

30366 

D 

0 

3 

5 

-1.85 

0.56 

0.16 

-0.45 

30367 

* 

-1 

4932 

99 

1.21 

0.02 

0.00 

0.03 

30367 

A 

1 

46 

74 

1.09 

0.14 

0.91 

0.43 

30367 

B 

0 

5 

8 

0.03 

0.46 

0.76 

-0.23 

30367 

C 

0 

8 

13 

0.47 

0.32 

1.28 

-0.13 

30367 

D 

0 

3 

5 

-0.88 

0.40 

0.26 

-0.38 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30368 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.06 

30368 

A 

1 

52 

93 

0.63 

0.17 

1.11 

0.33 

30368 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30368 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30368 

D 

0 

4 

7 

-0.98 

0.56 

0.73 

-0.33 

30369 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30369 

A 

1 

47 

84 

1.00 

0.14 

0.87 

0.46 

30369 

B 

0 

5 

9 

-0.13 

0.20 

0.59 

-0.27 

30369 

C 

0 

1 

2 

1.25 

0.00 

2.18 

0.06 

30369 

D 

0 

3 

5 

-1.12 

0.28 

0.22 

-0.44 

30370 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30370 

A 

1 

48 

86 

1.07 

0.16 

0.75 

0.55 

30370 

B 

0 

1 

2 

-1.29 

0.00 

0.21 

-0.21 

30370 

C 

0 

2 

4 

-0.06 

0.54 

0.83 

-0.12 

30370 

D 

0 

5 

9 

-1.33 

0.70 

0.43 

-0.50 

30371 

* 

-1 

4923 

99 

1.21 

0.02 

0.00 

0.02 

30371 

A 

1 

9 

13 

1.65 

0.51 

2.01 

0.22 

30371 

B 

0 

40 

56 

1.04 

0.16 

1.22 

0.05 

30371 

C 

0 

4 

6 

1.12 

0.59 

1.43 

0.03 

30371 

D 

0 

18 

25 

0.52 

0.25 

0.67 

-0.24 

30372 

* 

-1 

4721 

95 

1.15 

0.02 

0.00 

-0.16 

30372 

A 

1 

217 

79 

2.31 

0.09 

1.53 

0.32 

30372 

B 

0 

26 

10 

1.35 

0.22 

1.20 

-0.17 

30372 

C 

0 

28 

10 

1.20 

0.15 

0.90 

-0.22 

30372 

D 

0 

2 

1 

0.11 

0.91 

0.31 

-0.12 

30373 

* 

-1 

4593 

92 

1.14 

0.02 

0.00 

-0.15 

30373 

A 

1 

189 

47 

2.79 

0.09 

0.88 

0.60 

30373 

B 

0 

176 

44 

1.25 

0.07 

0.78 

-0.42 

30373 

C 

0 

22 

5 

0.84 

0.21 

0.51 

-0.19 

30373 

D 

0 

14 

3 

-0.18 

0.36 

0.23 

-0.29 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30374 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30374 

A 

1 

33 

59 

1.35 

0.25 

0.95 

0.46 

30374 

B 

0 

3 

5 

0.51 

0.11 

0.98 

-0.05 

30374 

C 

0 

9 

16 

-0.35 

0.35 

0.67 

-0.36 

30374 

D 

0 

11 

20 

0.19 

0.28 

1.03 

-0.22 

30375 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.04 

30375 

A 

1 

17 

29 

1.05 

0.30 

1.40 

0.20 

30375 

B 

0 

12 

21 

0.11 

0.36 

0.81 

-0.24 

30375 

C 

0 

7 

12 

1.13 

0.20 

1.44 

0.14 

30375 

D 

0 

22 

38 

0.55 

0.25 

1.28 

-0.08 

30376 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.04 

30376 

A 

1 

25 

47 

1.31 

0.23 

0.97 

0.48 

30376 

B 

0 

4 

8 

-0.01 

0.28 

0.54 

-0.17 

30376 

C 

0 

8 

15 

0.88 

0.37 

1.73 

0.06 

30376 

D 

0 

16 

30 

-0.18 

0.24 

0.58 

-0.48 

30377 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.05 

30377 

A 

1 

11 

19 

1.85 

0.47 

0.97 

0.45 

30377 

B 

0 

10 

18 

0.75 

0.28 

1.15 

0.05 

30377 

C 

0 

20 

35 

0.53 

0.23 

1.12 

-0.04 

30377 

D 

0 

16 

28 

-0.24 

0.33 

0.55 

-0.39 

30378 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30378 

A 

1 

14 

25 

2.43 

0.46 

0.78 

0.61 

30378 

B 

0 

4 

7 

0.96 

0.78 

2.05 

0.02 

30378 

C 

0 

27 

48 

0.04 

0.17 

0.58 

-0.52 

30378 

D 

0 

11 

20 

0.77 

0.23 

1.10 

-0.02 

30379 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.05 

30379 

A 

1 

12 

21 

1.27 

0.33 

1.50 

0.28 

30379 

B 

0 

29 

50 

0.64 

0.19 

1.20 

0.00 

30379 

C 

0 

9 

16 

0.84 

0.36 

1.38 

0.08 

30379 

D 

0 

8 

14 

-0.54 

0.35 

0.31 

-0.41 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30380 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.05 

30380 

A 

1 

10 

18 

1.11 

0.54 

2.78 

0.23 

30380 

B 

0 

23 

42 

0.69 

0.21 

1.34 

0.11 

30380 

C 

0 

6 

11 

0.66 

0.37 

1.20 

0.04 

30380 

D 

0 

16 

29 

-0.08 

0.23 

0.63 

-0.34 

30381 

* 

-1 

4932 

99 

1.21 

0.02 

0.00 

0.02 

30381 

A 

1 

48 

77 

1.03 

0.13 

1.08 

0.12 

30381 

B 

0 

4 

6 

1.41 

0.53 

2.95 

0.12 

30381 

C 

0 

8 

13 

0.54 

0.47 

1.50 

-0.17 

30381 

D 

0 

2 

3 

0.32 

1.01 

1.02 

-0.12 

30382 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.01 

30382 

A 

1 

45 

79 

1.35 

0.18 

0.87 

0.46 

30382 

B 

0 

3 

5 

0.17 

0.27 

0.68 

-0.16 

30382 

C 

0 

5 

9 

0.30 

0.36 

0.90 

-0.18 

30382 

D 

0 

4 

7 

-0.82 

0.50 

0.31 

-0.39 

30383 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.04 

30383 

A 

1 

43 

80 

0.96 

0.19 

0.90 

0.39 

30383 

B 

0 

2 

4 

-0.59 

0.66 

0.52 

-0.19 

30383 

C 

0 

3 

6 

-0.21 

0.58 

0.81 

-0.17 

30383 

D 

0 

6 

11 

-0.27 

0.53 

1.07 

-0.26 

30384 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.04 

30384 

A 

1 

47 

85 

1.03 

0.16 

0.78 

0.51 

30384 

B 

0 

1 

2 

-1.03 

0.00 

0.26 

-0.18 

30384 

C 

0 

1 

2 

0.43 

0.00 

1.13 

-0.03 

30384 

D 

0 

6 

11 

-1.10 

0.71 

0.47 

-0.48 

30385 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.05 

30385 

A 

1 

48 

81 

0.89 

0.15 

0.84 

0.50 

30385 

B 

0 

1 

2 

-0.50 

0.00 

0.48 

-0.12 

30385 

C 

0 

5 

8 

-0.37 

0.30 

0.62 

-0.25 

30385 

D 

0 

5 

8 

-0.93 

0.58 

0.59 

-0.39 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30386 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.02 

30386 

A 

1 

47 

84 

1.20 

0.18 

1.06 

0.44 

30386 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30386 

C 

0 

5 

9 

-0.14 

0.21 

0.57 

-0.27 

30386 

D 

0 

4 

7 

-0.54 

0.62 

0.56 

-0.33 

30387 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

30387 

A 

1 

46 

81 

0.88 

0.13 

0.99 

0.18 

30387 

B 

0 

5 

9 

1.52 

0.57 

5.76 

0.22 

30387 

C 

0 

4 

7 

-0.23 

0.12 

0.47 

-0.28 

30387 

D 

0 

2 

4 

-0.91 

1.36 

0.48 

-0.33 

30388 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

30388 

A 

1 

42 

75 

0.91 

0.19 

1.07 

0.33 

30388 

B 

0 

6 

11 

0.90 

0.20 

1.97 

0.06 

30388 

C 

0 

2 

4 

-0.45 

0.50 

0.52 

-0.17 

30388 

D 

0 

6 

11 

-0.81 

0.37 

0.44 

-0.41 

30389 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.02 

30389 

A 

1 

30 

55 

1.74 

0.28 

0.88 

0.57 

30389 

B 

0 

12 

22 

0.41 

0.23 

1.04 

-0.18 

30389 

C 

0 

7 

13 

-0.21 

0.30 

0.50 

-0.28 

30389 

D 

0 

6 

11 

-0.75 

0.45 

0.36 

-0.38 

30390 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.03 

30390 

A 

1 

4 

7 

0.56 

0.28 

2.03 

-0.08 

30390 

B 

0 

43 

73 

1.16 

0.12 

1.31 

0.59 

30390 

C 

0 

3 

5 

-0.53 

0.41 

0.21 

-0.35 

30390 

D 

0 

9 

15 

-0.17 

0.17 

0.30 

-0.47 

30391 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

30391 

A 

1 

37 

66 

1.06 

0.20 

0.98 

0.37 

30391 

B 

0 

3 

5 

0.14 

0.76 

1.23 

-0.08 

30391 

C 

0 

4 

7 

0.41 

0.98 

4.35 

-0.04 

30391 

D 

0 

12 

21 

-0.41 

0.61 

1.25 

-0.35 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30392 

* 

-1 

4720 

95 

1.18 

0.02 

0.00 

-0.08 

30392 

A 

1 

179 

65 

2.09 

0.10 

1.09 

0.42 

30392 

B 

0 

43 

16 

0.93 

0.15 

1.06 

-0.22 

30392 

C 

0 

46 

17 

0.84 

0.16 

1.02 

-0.26 

30392 

D 

0 

6 

2 

0.01 

0.58 

0.48 

-0.17 

30393 

* 

-1 

4920 

99 

1.21 

0.02 

0.00 

0.03 

30393 

A 

1 

41 

55 

1.25 

0.20 

1.21 

0.34 

30393 

B 

0 

10 

14 

0.40 

0.26 

0.92 

-0.15 

30393 

C 

0 

11 

15 

0.83 

0.24 

1.41 

-0.01 

30393 

D 

0 

12 

16 

0.01 

0.34 

0.78 

-0.31 

30394 

* 

-1 

4687 

94 

1.17 

0.02 

0.00 

-0.12 

30394 

A 

1 

245 

80 

2.08 

0.08 

0.97 

0.39 

30394 

B 

0 

24 

8 

0.97 

0.21 

1.08 

-0.18 

30394 

C 

0 

30 

10 

0.94 

0.17 

0.98 

-0.21 

30394 

D 

0 

8 

3 

-0.59 

0.31 

0.18 

-0.29 

30395 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.05 

30395 

A 

1 

8 

14 

1.78 

0.61 

0.96 

0.40 

30395 

B 

0 

16 

29 

0.78 

0.20 

1.29 

0.11 

30395 

C 

0 

11 

20 

0.59 

0.24 

1.09 

0.01 

30395 

D 

0 

21 

38 

-0.07 

0.24 

0.63 

-0.41 

30396 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.01 

30396 

A 

1 

20 

35 

1.64 

0.27 

0.99 

0.41 

30396 

B 

0 

12 

21 

0.80 

0.25 

1.00 

-0.12 

30396 

C 

0 

4 

7 

0.60 

0.60 

0.87 

-0.11 

30396 

D 

0 

21 

37 

0.70 

0.18 

0.89 

-0.25 

30397 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30397 

A 

1 

13 

23 

1.78 

0.53 

1.36 

0.39 

30397 

B 

0 

9 

16 

0.75 

0.45 

1.46 

-0.03 

30397 

C 

0 

9 

16 

0.54 

0.36 

1.16 

-0.09 

30397 

D 

0 

25 

45 

0.46 

0.18 

0.85 

-0.24 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30398 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

30398 

A 

1 

20 

35 

1.27 

0.23 

1.17 

0.35 

30398 

B 

0 

18 

32 

0.97 

0.18 

1.33 

0.13 

30398 

C 

0 

11 

19 

0.29 

0.25 

0.72 

-0.24 

30398 

D 

0 

8 

14 

-0.15 

0.31 

0.46 

-0.38 

30399 

* 

-1 

4923 

99 

1.21 

0.02 

0.00 

0.04 

30399 

A 

1 

38 

54 

1.25 

0.22 

1.17 

0.42 

30399 

B 

0 

14 

20 

-0.02 

0.14 

0.58 

-0.30 

30399 

C 

0 

14 

20 

0.71 

0.22 

1.39 

-0.01 

30399 

D 

0 

5 

7 

-0.80 

0.49 

0.37 

-0.34 

30400 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.03 

30400 

A 

1 

19 

33 

1.38 

0.25 

1.03 

0.39 

30400 

B 

0 

25 

43 

0.85 

0.16 

1.23 

0.03 

30400 

C 

0 

7 

12 

-0.06 

0.30 

0.50 

-0.31 

30400 

D 

0 

7 

12 

-0.03 

0.31 

0.49 

-0.30 

30401 

* 

-1 

4949 

99 

1.21 

0.02 

0.00 

0.02 

30401 

A 

1 

44 

98 

1.01 

0.20 

0.88 

0.31 

30401 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30401 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30401 

D 

0 

1 

2 

-1.86 

0.00 

0.13 

-0.31 

30402 

* 

-1 

4955 

99 

1.21 

0.02 

0.00 

0.02 

30402 

A 

1 

33 

85 

1.20 

0.23 

0.83 

0.45 

30402 

B 

0 

5 

13 

-0.35 

0.38 

0.60 

-0.35 

30402 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30402 

D 

0 

1 

3 

-1.42 

0.00 

0.16 

-0.27 

30403 

* 

-1 

4948 

99 

1.21 

0.02 

0.00 

0.04 

30403 

A 

1 

42 

91 

0.81 

0.16 

0.81 

0.47 

30403 

B 

0 

2 

4 

-0.23 

0.38 

0.73 

-0.16 

30403 

C 

0 

2 

4 

-2.00 

0.27 

0.12 

-0.48 

30403 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30404 

* 

-1 

4950 

99 

1.21 

0.02 

0.00 

0.02 

30404 

A 

1 

40 

91 

0.98 

0.15 

1.10 

0.18 

30404 

B 

0 

2 

5 

0.00 

0.84 

0.81 

-0.21 

30404 

C 

0 

2 

5 

0.75 

1.20 

2.24 

-0.04 

30404 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30405 

* 

-1 

4954 

99 

1.21 

0.02 

0.00 

0.04 

30405 

A 

1 

25 

63 

0.84 

0.17 

1.31 

0.27 

30405 

B 

0 

13 

33 

0.55 

0.32 

1.50 

-0.02 

30405 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30405 

D 

0 

2 

5 

-2.31 

1.88 

0.18 

-0.54 

30406 

* 

-1 

4948 

99 

1.21 

0.02 

0.00 

0.02 

30406 

A 

1 

43 

93 

0.94 

0.20 

1.02 

0.21 

30406 

B 

0 

1 

2 

-0.51 

0.00 

0.44 

-0.16 

30406 

C 

0 

2 

4 

0.06 

0.82 

1.07 

-0.14 

30406 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30407 

* 

-1 

4944 

99 

1.21 

0.02 

0.00 

0.03 

30407 

A 

1 

35 

70 

1.22 

0.19 

0.90 

0.46 

30407 

B 

0 

13 

26 

0.00 

0.27 

0.74 

-0.40 

30407 

C 

0 

1 

2 

-2.14 

0.00 

0.06 

-0.34 

30407 

D 

0 

1 

2 

1.54 

0.00 

2.52 

0.08 

30408 

* 

-1 

4945 

99 

1.21 

0.02 

0.00 

0.03 

30408 

A 

1 

45 

92 

0.85 

0.14 

1.02 

0.17 

30408 

B 

0 

4 

8 

0.28 

0.34 

0.94 

-0.17 

30408 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30408 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30409 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.03 

30409 

A 

1 

8 

15 

1.55 

0.50 

1.34 

0.28 

30409 

B 

0 

26 

47 

0.66 

0.18 

0.90 

-0.16 

30409 

C 

0 

20 

36 

0.79 

0.24 

1.12 

-0.03 

30409 

D 

0 

1 

2 

0.70 

0.00 

0.61 

-0.02 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30410 

* 

-1 

4958 

99 

1.21 

0.02 

0.00 

0.05 

30410 

A 

1 

33 

92 

0.57 

0.26 

1.97 

0.25 

30410 

B 

0 

3 

8 

-0.75 

0.53 

0.85 

-0.25 

30410 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30410 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30411 

* 

-1 

4947 

99 

1.21 

0.02 

0.00 

0.02 

30411 

A 

1 

45 

96 

0.99 

0.18 

0.99 

0.24 

30411 

B 

0 

1 

2 

-0.03 

0.00 

0.64 

-0.12 

30411 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30411 

D 

0 

1 

2 

-0.75 

0.00 

0.31 

-0.21 

30412 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.03 

30412 

A 

1 

52 

90 

0.93 

0.15 

1.06 

0.17 

30412 

B 

0 

2 

3 

1.09 

0.97 

2.87 

0.04 

30412 

C 

0 

3 

5 

0.29 

0.15 

0.87 

-0.13 

30412 

D 

0 

1 

2 

-1.06 

0.00 

0.22 

-0.24 

30413 

* 

-1 

4952 

99 

1.21 

0.02 

0.00 

0.02 

30413 

A 

1 

38 

90 

1.00 

0.18 

1.00 

0.26 

30413 

B 

0 

2 

5 

0.17 

0.23 

0.72 

-0.16 

30413 

C 

0 

2 

5 

-0.08 

0.43 

0.59 

-0.21 

30413 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30414 

* 

-1 

4926 

99 

1.22 

0.02 

0.00 

0.06 

30414 

A 

1 

35 

51 

1.12 

0.17 

0.97 

0.53 

30414 

B 

0 

13 

19 

0.26 

0.25 

1.09 

-0.12 

30414 

C 

0 

11 

16 

-0.60 

0.26 

0.43 

-0.44 

30414 

D 

0 

9 

13 

0.06 

0.27 

0.82 

-0.16 

30415 

* 

-1 

4946 

99 

1.21 

0.02 

0.00 

0.03 

30415 

A 

1 

47 

98 

0.88 

0.12 

0.96 

0.29 

30415 

B 

0 

1 

2 

-0.90 

0.00 

0.25 

-0.29 

30415 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30415 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30416 

* 

-1 

4947 

99 

1.21 

0.02 

0.00 

0.03 

30416 

A 

1 

40 

85 

0.94 

0.14 

1.02 

0.30 

30416 

B 

0 

2 

4 

-0.13 

0.17 

0.50 

-0.23 

30416 

C 

0 

2 

4 

-0.12 

0.11 

0.50 

-0.23 

30416 

D 

0 

3 

6 

0.62 

0.22 

1.10 

-0.06 

30417 

* 

-1 

4950 

99 

1.21 

0.02 

0.00 

0.01 

30417 

A 

1 

24 

55 

1.59 

0.30 

1.20 

0.40 

30417 

B 

0 

14 

32 

0.39 

0.24 

0.88 

-0.37 

30417 

C 

0 

3 

7 

1.58 

0.14 

1.92 

0.10 

30417 

D 

0 

3 

7 

0.16 

0.42 

0.53 

-0.20 

30418 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

30418 

A 

1 

42 

74 

1.24 

0.23 

1.20 

0.40 

30418 

B 

0 

10 

18 

0.22 

0.20 

0.91 

-0.21 

30418 

C 

0 

4 

7 

-0.63 

0.78 

0.82 

-0.29 

30418 

D 

0 

1 

2 

-0.69 

0.00 

0.31 

-0.15 

30419 

* 

-1 

4961 

99 

1.21 

0.02 

0.00 

0.02 

30419 

A 

1 

27 

82 

1.19 

0.25 

1.10 

0.39 

30419 

B 

0 

4 

12 

0.22 

0.37 

0.81 

-0.14 

30419 

C 

0 

1 

3 

1.92 

0.00 

3.57 

0.11 

30419 

D 

0 

1 

3 

-5.89 

0.00 

0.00 

-0.70 

30420 

* 

-1 

4958 

99 

1.21 

0.02 

0.00 

0.03 

30420 

A 

1 

24 

67 

0.83 

0.19 

1.31 

0.27 

30420 

B 

0 

8 

22 

0.40 

0.21 

1.00 

-0.18 

30420 

C 

0 

2 

6 

0.33 

0.06 

0.77 

-0.10 

30420 

D 

0 

2 

6 

0.21 

0.33 

0.72 

-0.14 

30421 

* 

-1 

4944 

99 

1.21 

0.02 

0.00 

0.03 

30421 

A 

1 

38 

76 

1.13 

0.17 

0.85 

0.48 

30421 

B 

0 

3 

6 

-0.43 

0.20 

0.39 

-0.29 

30421 

C 

0 

5 

10 

0.06 

0.48 

0.96 

-0.23 

30421 

D 

0 

4 

8 

-0.11 

0.26 

0.57 

-0.25 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30422 

* 

-1 

4959 

99 

1.21 

0.02 

0.00 

0.03 

30422 

A 

1 

30 

86 

0.91 

0.18 

0.90 

0.38 

30422 

B 

0 

5 

14 

-0.20 

0.41 

0.72 

-0.38 

30422 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30422 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30423 

* 

-1 

4943 

99 

1.21 

0.02 

0.00 

0.01 

30423 

A 

1 

26 

51 

1.49 

0.21 

1.05 

0.41 

30423 

B 

0 

1 

2 

-1.29 

0.00 

0.10 

-0.31 

30423 

C 

0 

24 

47 

0.70 

0.17 

0.95 

-0.32 

30423 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30424 

* 

-1 

4943 

99 

1.21 

0.02 

0.00 

0.04 

30424 

A 

1 

45 

88 

0.79 

0.17 

0.96 

0.34 

30424 

B 

0 

1 

2 

-0.35 

0.00 

0.57 

-0.12 

30424 

C 

0 

2 

4 

0.43 

0.01 

1.24 

-0.04 

30424 

D 

0 

3 

6 

-0.99 

0.33 

0.33 

-0.36 

30425 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.03 

30425 

A 

1 

45 

82 

0.89 

0.14 

1.16 

0.12 

30425 

B 

0 

2 

4 

0.41 

0.50 

0.93 

-0.09 

30425 

C 

0 

5 

9 

0.90 

0.36 

1.68 

0.02 

30425 

D 

0 

3 

5 

0.28 

0.21 

0.76 

-0.15 

30426 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.03 

30426 

A 

1 

50 

85 

1.11 

0.13 

0.82 

0.57 

30426 

B 

0 

4 

7 

-0.31 

0.38 

0.54 

-0.30 

30426 

C 

0 

2 

3 

-1.00 

0.28 

0.23 

-0.33 

30426 

D 

0 

3 

5 

-0.62 

0.33 

0.36 

-0.32 

30427 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.05 

30427 

A 

1 

49 

86 

0.59 

0.15 

2.06 

0.09 

30427 

B 

0 

5 

9 

0.94 

0.48 

2.89 

0.11 

30427 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30427 

D 

0 

3 

5 

-0.74 

0.50 

0.47 

-0.28 

easyCBM  CCSS  Third  Grade  Math  Measure  Development 


298 

Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30428 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.05 

30428 

A 

1 

53 

93 

0.71 

0.15 

1.04 

0.25 

30428 

B 

0 

3 

5 

-0.91 

0.24 

0.37 

-0.33 

30428 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30428 

D 

0 

1 

2 

1.22 

0.00 

2.92 

0.07 

30429 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.05 

30429 

A 

1 

52 

91 

0.70 

0.15 

1.02 

0.21 

30429 

B 

0 

4 

7 

0.17 

0.64 

1.57 

-0.11 

30429 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30429 

D 

0 

1 

2 

-1.18 

0.00 

0.26 

-0.22 

30430 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

30430 

A 

1 

47 

82 

0.91 

0.19 

1.12 

0.22 

30430 

B 

0 

3 

5 

0.23 

0.23 

0.89 

-0.11 

30430 

C 

0 

5 

9 

0.18 

0.39 

1.04 

-0.15 

30430 

D 

0 

2 

4 

0.29 

0.09 

0.90 

-0.08 

30431 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.03 

30431 

A 

1 

47 

89 

1.00 

0.15 

0.93 

0.39 

30431 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30431 

C 

0 

5 

9 

-0.17 

0.10 

0.53 

-0.31 

30431 

D 

0 

1 

2 

-0.99 

0.00 

0.23 

-0.24 

30432 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.05 

30432 

A 

1 

44 

77 

0.72 

0.14 

1.10 

0.21 

30432 

B 

0 

9 

16 

0.56 

0.26 

1.50 

-0.03 

30432 

C 

0 

3 

5 

-0.38 

0.41 

0.54 

-0.26 

30432 

D 

0 

1 

2 

-0.36 

0.00 

0.46 

-0.15 

30433 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.06 

30433 

A 

1 

44 

81 

0.57 

0.15 

1.04 

0.32 

30433 

B 

0 

3 

6 

-0.04 

0.68 

1.37 

-0.11 

30433 

C 

0 

4 

7 

-0.21 

0.26 

0.77 

-0.18 

30433 

D 

0 

3 

6 

-0.47 

0.72 

0.90 

-0.22 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30434 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.03 

30434 

A 

1 

53 

88 

0.95 

0.16 

1.03 

0.28 

30434 

B 

0 

5 

8 

-0.16 

0.50 

0.87 

-0.26 

30434 

C 

0 

2 

3 

0.15 

0.18 

0.81 

-0.11 

30434 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30435 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.04 

30435 

A 

1 

47 

85 

0.78 

0.15 

1.13 

0.14 

30435 

B 

0 

5 

9 

0.54 

0.50 

1.87 

-0.06 

30435 

C 

0 

2 

4 

0.16 

0.27 

0.83 

-0.11 

30435 

D 

0 

1 

2 

0.09 

0.00 

0.74 

-0.09 

30436 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.02 

30436 

A 

1 

52 

87 

0.99 

0.14 

1.21 

0.11 

30436 

B 

0 

5 

8 

1.21 

0.81 

6.57 

0.07 

30436 

C 

0 

2 

3 

-0.29 

0.19 

0.44 

-0.21 

30436 

D 

0 

1 

2 

-0.36 

0.00 

0.40 

-0.16 

30437 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

30437 

A 

1 

47 

82 

1.04 

0.16 

1.11 

0.40 

30437 

B 

0 

3 

5 

0.61 

0.27 

1.09 

-0.03 

30437 

C 

0 

5 

9 

0.07 

0.23 

0.65 

-0.16 

30437 

D 

0 

2 

4 

-3.00 

2.70 

0.41 

-0.53 

30438 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

30438 

A 

1 

52 

91 

0.90 

0.16 

1.06 

0.25 

30438 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30438 

C 

0 

4 

7 

-0.23 

0.25 

0.62 

-0.26 

30438 

D 

0 

1 

2 

0.63 

0.00 

1.32 

-0.02 

30439 

* 

-1 

4927 

99 

1.22 

0.02 

0.00 

0.07 

30439 

A 

1 

56 

84 

0.58 

0.14 

0.97 

0.39 

30439 

B 

0 

6 

9 

-1.21 

0.30 

0.36 

-0.45 

30439 

C 

0 

4 

6 

0.33 

0.39 

1.73 

-0.01 

30439 

D 

0 

1 

1 

-0.76 

0.00 

0.46 

-0.13 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30440 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.05 

30440 

A 

1 

39 

68 

0.97 

0.15 

0.86 

0.53 

30440 

B 

0 

4 

7 

-0.50 

0.22 

0.42 

-0.31 

30440 

C 

0 

3 

5 

0.47 

0.43 

1.26 

-0.03 

30440 

D 

0 

11 

19 

-0.20 

0.19 

0.63 

-0.40 

30441 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.03 

30441 

A 

1 

47 

78 

1.16 

0.14 

0.76 

0.57 

30441 

B 

0 

2 

3 

-0.70 

0.94 

0.46 

-0.22 

30441 

C 

0 

3 

5 

-0.69 

0.92 

0.63 

-0.27 

30441 

D 

0 

8 

13 

-0.48 

0.48 

0.83 

-0.40 

30442 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30442 

A 

1 

35 

63 

1.37 

0.14 

0.72 

0.65 

30442 

B 

0 

2 

4 

-0.63 

0.29 

0.27 

-0.26 

30442 

C 

0 

10 

18 

0.18 

0.28 

0.82 

-0.28 

30442 

D 

0 

9 

16 

-0.23 

0.29 

0.52 

-0.43 

30443 

* 

-1 

4713 

94 

1.19 

0.02 

0.00 

-0.04 

30443 

A 

1 

229 

81 

1.70 

0.07 

0.88 

0.46 

30443 

B 

0 

21 

7 

0.10 

0.32 

0.84 

-0.30 

30443 

C 

0 

24 

9 

0.49 

0.20 

0.89 

-0.23 

30443 

D 

0 

7 

2 

-0.38 

0.13 

0.26 

-0.23 

30444 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.02 

30444 

A 

1 

42 

74 

1.32 

0.14 

0.74 

0.62 

30444 

B 

0 

10 

18 

-0.13 

0.26 

0.58 

-0.47 

30444 

C 

0 

3 

5 

-0.42 

0.15 

0.33 

-0.31 

30444 

D 

0 

2 

4 

0.12 

0.51 

0.63 

-0.15 

30445 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.01 

30445 

A 

1 

40 

69 

1.35 

0.13 

0.99 

0.41 

30445 

B 

0 

5 

9 

0.81 

0.55 

1.53 

-0.08 

30445 

C 

0 

5 

9 

0.23 

0.58 

0.83 

-0.26 

30445 

D 

0 

8 

14 

0.36 

0.39 

0.93 

-0.28 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30446 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.05 

30446 

A 

1 

39 

70 

1.13 

0.16 

0.81 

0.61 

30446 

B 

0 

9 

16 

-0.17 

0.30 

0.76 

-0.29 

30446 

C 

0 

5 

9 

-0.88 

0.43 

0.41 

-0.39 

30446 

D 

0 

3 

5 

-0.81 

0.54 

0.40 

-0.28 

30447 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

30447 

A 

1 

34 

60 

1.39 

0.18 

0.83 

0.58 

30447 

B 

0 

7 

12 

0.49 

0.15 

0.84 

-0.12 

30447 

C 

0 

7 

12 

-0.06 

0.27 

0.54 

-0.30 

30447 

D 

0 

9 

16 

-0.19 

0.25 

0.50 

-0.40 

30448 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

30448 

A 

1 

51 

89 

0.93 

0.18 

0.91 

0.35 

30448 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30448 

C 

0 

2 

4 

-0.11 

0.16 

0.72 

-0.13 

30448 

D 

0 

4 

7 

-0.79 

0.75 

0.58 

-0.32 

30449 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.05 

30449 

A 

1 

28 

50 

1.24 

0.19 

0.85 

0.55 

30449 

B 

0 

9 

16 

0.07 

0.43 

1.00 

-0.16 

30449 

C 

0 

9 

16 

0.02 

0.20 

0.66 

-0.18 

30449 

D 

0 

10 

18 

-0.49 

0.45 

0.65 

-0.38 

30450 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

30450 

A 

1 

48 

84 

1.11 

0.15 

0.92 

0.51 

30450 

B 

0 

1 

2 

-1.34 

0.00 

0.16 

-0.26 

30450 

C 

0 

3 

5 

0.03 

0.47 

0.80 

-0.18 

30450 

D 

0 

5 

9 

-0.57 

0.23 

0.39 

-0.40 

30451 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.01 

30451 

A 

1 

30 

51 

1.65 

0.19 

0.81 

0.54 

30451 

B 

0 

22 

37 

0.55 

0.14 

0.77 

-0.41 

30451 

C 

0 

4 

7 

0.72 

0.37 

0.93 

-0.10 

30451 

D 

0 

3 

5 

0.08 

0.31 

0.43 

-0.23 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30452 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.03 

30452 

A 

1 

30 

56 

1.20 

0.18 

1.06 

0.40 

30452 

B 

0 

16 

30 

0.60 

0.22 

1.28 

-0.13 

30452 

C 

0 

2 

4 

0.83 

0.32 

1.12 

0.00 

30452 

D 

0 

6 

11 

-0.52 

0.35 

0.37 

-0.45 

30453 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.06 

30453 

A 

1 

21 

39 

1.33 

0.29 

0.80 

0.58 

30453 

B 

0 

22 

41 

-0.16 

0.21 

0.80 

-0.37 

30453 

C 

0 

5 

9 

-0.33 

0.37 

0.57 

-0.19 

30453 

D 

0 

6 

11 

-0.10 

0.18 

0.61 

-0.14 

30454 

* 

-1 

4942 

99 

1.21 

0.02 

0.00 

0.04 

30454 

A 

1 

24 

46 

1.05 

0.18 

0.93 

0.40 

30454 

B 

0 

2 

4 

0.16 

0.09 

0.60 

-0.11 

30454 

C 

0 

20 

38 

0.46 

0.17 

1.06 

-0.17 

30454 

D 

0 

6 

12 

-0.12 

0.40 

0.64 

-0.31 

30455 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.02 

30455 

A 

1 

35 

58 

1.37 

0.16 

0.98 

0.46 

30455 

B 

0 

9 

15 

0.46 

0.29 

0.85 

-0.25 

30455 

C 

0 

3 

5 

0.24 

0.21 

0.52 

-0.19 

30455 

D 

0 

13 

22 

0.62 

0.16 

0.84 

-0.22 

30456 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.03 

30456 

A 

1 

26 

48 

1.44 

0.22 

0.80 

0.47 

30456 

B 

0 

17 

31 

0.61 

0.29 

1.65 

-0.13 

30456 

C 

0 

3 

6 

0.13 

0.08 

0.53 

-0.14 

30456 

D 

0 

8 

15 

-0.31 

0.25 

0.40 

-0.40 

30457 

* 

-1 

4701 

94 

1.17 

0.02 

0.00 

-0.12 

30457 

A 

1 

279 

95 

1.92 

0.07 

0.97 

0.25 

30457 

B 

0 

7 

2 

0.93 

0.26 

0.84 

-0.12 

30457 

C 

0 

6 

2 

0.05 

0.42 

0.44 

-0.21 

30457 

D 

0 

1 

0 

-0.06 

0.00 

0.26 

-0.09 

easyCBM  CCSS  Third  Grade  Math  Measure  Development 


303 

Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30458 

* 

-1 

4945 

99 

1.21 

0.02 

0.00 

0.05 

30458 

A 

1 

42 

86 

0.75 

0.14 

0.99 

0.45 

30458 

B 

0 

5 

10 

-0.14 

0.36 

0.91 

-0.23 

30458 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30458 

D 

0 

2 

4 

-1.67 

0.05 

0.15 

-0.45 

30459 

* 

-1 

4950 

99 

1.21 

0.02 

0.00 

0.03 

30459 

A 

1 

30 

68 

1.20 

0.20 

0.93 

0.49 

30459 

B 

0 

5 

11 

0.16 

0.60 

1.26 

-0.19 

30459 

C 

0 

1 

2 

-0.68 

0.00 

0.28 

-0.19 

30459 

D 

0 

8 

18 

-0.14 

0.33 

0.66 

-0.37 

30460 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.05 

30460 

A 

1 

14 

24 

1.21 

0.22 

0.99 

0.38 

30460 

B 

0 

22 

38 

0.69 

0.17 

1.14 

0.03 

30460 

C 

0 

19 

33 

0.33 

0.17 

0.80 

-0.26 

30460 

D 

0 

3 

5 

-0.25 

0.31 

0.38 

-0.25 

30461 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.03 

30461 

A 

1 

35 

60 

1.25 

0.20 

1.04 

0.47 

30461 

B 

0 

10 

17 

0.41 

0.18 

0.88 

-0.17 

30461 

C 

0 

7 

12 

-0.16 

0.17 

0.47 

-0.33 

30461 

D 

0 

6 

10 

0.24 

0.34 

0.81 

-0.18 

30462 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.04 

30462 

A 

1 

31 

58 

1.19 

0.21 

0.98 

0.49 

30462 

B 

0 

7 

13 

0.47 

0.34 

1.22 

-0.09 

30462 

C 

0 

5 

9 

0.27 

0.24 

0.81 

-0.13 

30462 

D 

0 

10 

19 

-0.34 

0.19 

0.46 

-0.45 

30463 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.04 

30463 

A 

1 

20 

37 

1.48 

0.19 

0.90 

0.38 

30463 

B 

0 

7 

13 

0.87 

0.66 

2.68 

0.04 

30463 

C 

0 

12 

22 

0.55 

0.31 

1.02 

-0.06 

30463 

D 

0 

15 

28 

-0.19 

0.50 

0.74 

-0.38 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30464 

* 

-1 

4942 

99 

1.21 

0.02 

0.00 

0.04 

30464 

A 

1 

16 

31 

1.48 

0.19 

0.75 

0.45 

30464 

B 

0 

7 

13 

0.83 

0.37 

1.39 

0.04 

30464 

C 

0 

10 

19 

0.58 

0.30 

1.03 

-0.06 

30464 

D 

0 

19 

37 

0.10 

0.29 

0.68 

-0.41 

30465 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

30465 

A 

1 

21 

37 

1.32 

0.19 

0.88 

0.47 

30465 

B 

0 

5 

9 

0.29 

0.23 

0.64 

-0.14 

30465 

C 

0 

17 

30 

0.74 

0.19 

1.22 

0.00 

30465 

D 

0 

14 

25 

0.01 

0.24 

0.65 

-0.44 

30466 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.02 

30466 

A 

1 

39 

67 

1.18 

0.17 

2.22 

0.28 

30466 

B 

0 

4 

7 

0.75 

0.60 

1.45 

-0.07 

30466 

C 

0 

3 

5 

0.88 

0.37 

1.12 

-0.02 

30466 

D 

0 

12 

21 

0.47 

0.19 

0.78 

-0.27 

30467 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30467 

A 

1 

25 

45 

1.54 

0.21 

0.78 

0.60 

30467 

B 

0 

12 

21 

0.43 

0.25 

0.96 

-0.20 

30467 

C 

0 

3 

5 

0.04 

0.43 

0.53 

-0.18 

30467 

D 

0 

16 

29 

0.19 

0.14 

0.60 

-0.39 

30468 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.03 

30468 

A 

1 

6 

11 

1.88 

0.77 

1.25 

0.27 

30468 

B 

0 

14 

26 

1.01 

0.30 

1.34 

0.08 

30468 

C 

0 

21 

40 

0.95 

0.22 

1.32 

0.07 

30468 

D 

0 

12 

23 

-0.12 

0.49 

0.62 

-0.37 

30469 

* 

-1 

4946 

99 

1.21 

0.02 

0.00 

0.02 

30469 

A 

1 

13 

27 

1.99 

0.33 

0.81 

0.58 

30469 

B 

0 

11 

23 

0.47 

0.27 

0.72 

-0.19 

30469 

C 

0 

7 

15 

0.76 

0.35 

0.99 

-0.04 

30469 

D 

0 

17 

35 

0.35 

0.21 

0.62 

-0.34 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30470 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.05 

30470 

A 

1 

10 

18 

1.38 

0.35 

1.05 

0.35 

30470 

B 

0 

14 

25 

0.64 

0.26 

1.09 

0.01 

30470 

C 

0 

5 

9 

0.91 

0.42 

1.50 

0.09 

30470 

D 

0 

27 

48 

0.28 

0.18 

0.77 

-0.32 

30471 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.05 

30471 

A 

1 

26 

47 

1.10 

0.15 

0.82 

0.54 

30471 

B 

0 

8 

15 

0.50 

0.34 

1.34 

-0.04 

30471 

C 

0 

7 

13 

0.26 

0.10 

0.73 

-0.14 

30471 

D 

0 

14 

25 

-0.14 

0.20 

0.62 

-0.48 

30472 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.06 

30472 

A 

1 

25 

44 

1.22 

0.19 

0.75 

0.46 

30472 

B 

0 

5 

9 

0.25 

0.32 

0.83 

-0.06 

30472 

C 

0 

10 

18 

0.58 

0.25 

1.23 

0.02 

30472 

D 

0 

17 

30 

-0.47 

0.40 

0.74 

-0.48 

30473 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.04 

30473 

A 

1 

26 

45 

1.16 

0.16 

0.88 

0.42 

30473 

B 

0 

22 

38 

0.46 

0.21 

1.12 

-0.20 

30473 

C 

0 

4 

7 

0.33 

0.43 

0.87 

-0.10 

30473 

D 

0 

6 

10 

-0.10 

0.41 

0.61 

-0.28 

30474 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.06 

30474 

A 

1 

20 

36 

1.21 

0.17 

0.86 

0.39 

30474 

B 

0 

13 

23 

0.43 

0.28 

1.20 

-0.03 

30474 

C 

0 

7 

13 

0.33 

0.41 

1.04 

-0.05 

30474 

D 

0 

16 

29 

-0.23 

0.46 

0.92 

-0.35 

30475 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

30475 

A 

1 

24 

43 

0.85 

0.20 

1.36 

0.13 

30475 

B 

0 

10 

18 

0.91 

0.34 

2.19 

0.10 

30475 

C 

0 

9 

16 

0.84 

0.35 

1.63 

0.06 

30475 

D 

0 

13 

23 

0.13 

0.31 

0.87 

-0.30 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30476 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.03 

30476 

A 

1 

48 

87 

0.91 

0.18 

1.04 

0.23 

30476 

B 

0 

1 

2 

-1.20 

0.00 

0.21 

-0.23 

30476 

C 

0 

3 

5 

0.75 

0.55 

1.85 

-0.01 

30476 

D 

0 

3 

5 

-0.14 

0.16 

0.61 

-0.19 

30477 

* 

-1 

4937 

99 

1.22 

0.02 

0.00 

0.07 

30477 

A 

1 

40 

70 

0.68 

0.16 

0.92 

0.44 

30477 

B 

0 

7 

12 

-0.08 

0.36 

1.09 

-0.13 

30477 

C 

0 

4 

7 

0.26 

0.16 

1.15 

-0.02 

30477 

D 

0 

6 

11 

-1.36 

0.59 

0.46 

-0.50 

30478 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.04 

30478 

A 

1 

45 

85 

0.76 

0.16 

1.04 

0.23 

30478 

B 

0 

4 

8 

0.14 

0.43 

1.04 

-0.14 

30478 

C 

0 

1 

2 

1.37 

0.00 

2.85 

0.09 

30478 

D 

0 

3 

6 

-0.40 

0.68 

0.69 

-0.25 

30479 

* 

-1 

4945 

99 

1.21 

0.02 

0.00 

0.03 

30479 

A 

1 

27 

55 

1.47 

0.23 

0.83 

0.60 

30479 

B 

0 

2 

4 

-0.09 

0.67 

0.59 

-0.13 

30479 

C 

0 

8 

16 

0.18 

0.43 

1.10 

-0.19 

30479 

D 

0 

12 

24 

-0.34 

0.20 

0.47 

-0.47 

30480 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.04 

30480 

A 

1 

29 

53 

1.24 

0.21 

1.02 

0.47 

30480 

B 

0 

5 

9 

-0.29 

0.47 

0.54 

-0.23 

30480 

C 

0 

11 

20 

0.27 

0.26 

0.90 

-0.15 

30480 

D 

0 

10 

18 

-0.14 

0.51 

0.79 

-0.29 

30481 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

30481 

A 

1 

32 

57 

1.24 

0.17 

0.87 

0.46 

30481 

B 

0 

2 

4 

0.75 

0.09 

1.02 

0.00 

30481 

C 

0 

14 

25 

0.27 

0.29 

0.93 

-0.23 

30481 

D 

0 

8 

14 

-0.32 

0.62 

0.68 

-0.36 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30482 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.02 

30482 

A 

1 

40 

70 

1.24 

0.20 

1.12 

0.40 

30482 

B 

0 

4 

7 

0.07 

0.65 

0.91 

-0.19 

30482 

C 

0 

5 

9 

0.48 

0.41 

1.14 

-0.11 

30482 

D 

0 

8 

14 

0.04 

0.28 

0.70 

-0.29 

30483 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.05 

30483 

A 

1 

32 

56 

0.93 

0.13 

0.86 

0.43 

30483 

B 

0 

4 

7 

0.09 

0.59 

1.06 

-0.14 

30483 

C 

0 

5 

9 

-0.09 

0.37 

0.68 

-0.21 

30483 

D 

0 

16 

28 

0.16 

0.28 

1.19 

-0.27 

30484 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.05 

30484 

A 

1 

31 

56 

0.90 

0.19 

1.08 

0.31 

30484 

B 

0 

7 

13 

0.69 

0.48 

1.87 

0.04 

30484 

C 

0 

6 

11 

0.36 

0.39 

1.21 

-0.06 

30484 

D 

0 

11 

20 

-0.35 

0.45 

0.72 

-0.37 

30485 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.05 

30485 

A 

1 

12 

20 

1.54 

0.42 

1.17 

0.41 

30485 

B 

0 

23 

39 

0.44 

0.19 

1.04 

-0.10 

30485 

C 

0 

6 

10 

0.29 

0.36 

0.83 

-0.09 

30485 

D 

0 

18 

31 

0.26 

0.25 

0.99 

-0.19 

30486 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.02 

30486 

A 

1 

21 

37 

1.88 

0.25 

0.69 

0.60 

30486 

B 

0 

17 

30 

0.35 

0.15 

0.66 

-0.28 

30486 

C 

0 

2 

4 

2.00 

0.86 

3.90 

0.17 

30486 

D 

0 

17 

30 

0.09 

0.25 

0.65 

-0.42 

30487 

* 

-1 

4933 

99 

1.21 

0.02 

0.00 

0.04 

30487 

A 

1 

32 

52 

1.21 

0.20 

1.06 

0.40 

30487 

B 

0 

7 

11 

0.71 

0.38 

1.46 

-0.02 

30487 

C 

0 

7 

11 

0.45 

0.16 

0.83 

-0.10 

30487 

D 

0 

15 

25 

0.00 

0.31 

0.96 

-0.38 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30488 

* 

-1 

4936 

99 

1.22 

0.02 

0.00 

0.06 

30488 

A 

1 

16 

28 

0.96 

0.19 

0.93 

0.33 

30488 

B 

0 

8 

14 

0.34 

0.30 

1.00 

-0.03 

30488 

C 

0 

10 

17 

0.82 

0.28 

1.67 

0.18 

30488 

D 

0 

24 

41 

-0.09 

0.22 

0.70 

-0.42 

30489 

* 

-1 

4938 

99 

1.22 

0.02 

0.00 

0.07 

30489 

A 

1 

17 

30 

1.29 

0.21 

0.68 

0.49 

30489 

B 

0 

13 

23 

0.29 

0.32 

1.16 

-0.04 

30489 

C 

0 

7 

13 

0.19 

0.38 

1.03 

-0.06 

30489 

D 

0 

19 

34 

-0.33 

0.29 

0.79 

-0.40 

30490 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.02 

30490 

A 

1 

26 

46 

1.48 

0.26 

1.59 

0.37 

30490 

B 

0 

7 

12 

0.96 

0.40 

1.31 

-0.01 

30490 

C 

0 

4 

7 

0.08 

0.85 

0.71 

-0.21 

30490 

D 

0 

20 

35 

0.59 

0.15 

0.78 

-0.26 

30491 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.04 

30491 

A 

1 

22 

40 

1.16 

0.23 

1.00 

0.41 

30491 

B 

0 

10 

18 

0.16 

0.21 

0.67 

-0.27 

30491 

C 

0 

1 

2 

0.48 

0.00 

0.78 

-0.03 

30491 

D 

0 

22 

40 

0.47 

0.16 

0.97 

-0.19 

30492 

* 

-1 

4942 

99 

1.21 

0.02 

0.00 

0.04 

30492 

A 

1 

20 

38 

1.21 

0.19 

0.84 

0.45 

30492 

B 

0 

4 

8 

0.38 

0.07 

0.70 

-0.08 

30492 

C 

0 

6 

12 

0.54 

0.29 

1.02 

-0.04 

30492 

D 

0 

22 

42 

0.20 

0.23 

0.98 

-0.38 

30493 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.05 

30493 

A 

1 

40 

75 

0.85 

0.16 

0.99 

0.42 

30493 

B 

0 

1 

2 

0.62 

0.00 

1.28 

0.00 

30493 

C 

0 

5 

9 

-0.73 

0.40 

0.41 

-0.41 

30493 

D 

0 

7 

13 

0.11 

0.20 

0.88 

-0.18 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30494 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

30494 

A 

1 

34 

60 

1.10 

0.23 

1.23 

0.40 

30494 

B 

0 

5 

9 

-0.12 

0.35 

0.66 

-0.20 

30494 

C 

0 

5 

9 

0.17 

0.41 

0.94 

-0.13 

30494 

D 

0 

13 

23 

0.15 

0.24 

0.96 

-0.24 

30495 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.05 

30495 

A 

1 

28 

50 

1.17 

0.20 

0.99 

0.46 

30495 

B 

0 

5 

9 

0.13 

0.51 

1.10 

-0.11 

30495 

C 

0 

6 

11 

-0.19 

0.45 

0.86 

-0.21 

30495 

D 

0 

17 

30 

-0.01 

0.33 

0.94 

-0.30 

30496 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.05 

30496 

A 

1 

36 

65 

0.73 

0.15 

1.02 

0.32 

30496 

B 

0 

5 

9 

-0.03 

0.36 

0.80 

-0.20 

30496 

C 

0 

1 

2 

1.41 

0.00 

2.73 

0.14 

30496 

D 

0 

13 

24 

0.10 

0.21 

0.93 

-0.26 

30497 

* 

-1 

4933 

99 

1.21 

0.02 

0.00 

0.03 

30497 

A 

1 

45 

74 

1.03 

0.19 

1.12 

0.30 

30497 

B 

0 

3 

5 

0.38 

0.39 

1.02 

-0.08 

30497 

C 

0 

2 

3 

-0.11 

0.11 

0.53 

-0.15 

30497 

D 

0 

11 

18 

0.26 

0.23 

0.96 

-0.22 

30498 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.00 

30498 

A 

1 

35 

61 

1.53 

0.19 

0.90 

0.43 

30498 

B 

0 

3 

5 

0.80 

0.07 

0.84 

-0.07 

30498 

C 

0 

5 

9 

0.35 

0.55 

0.88 

-0.22 

30498 

D 

0 

14 

25 

0.53 

0.26 

0.87 

-0.31 

30499 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.05 

30499 

A 

1 

33 

59 

0.91 

0.19 

1.06 

0.31 

30499 

B 

0 

5 

9 

-0.33 

0.28 

0.52 

-0.26 

30499 

C 

0 

3 

5 

1.17 

0.29 

2.19 

0.12 

30499 

D 

0 

15 

27 

0.16 

0.34 

1.70 

-0.24 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30500 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.03 

30500 

A 

1 

40 

74 

1.21 

0.19 

0.82 

0.52 

30500 

B 

0 

2 

4 

-0.06 

0.13 

0.64 

-0.11 

30500 

C 

0 

2 

4 

0.10 

1.24 

1.41 

-0.09 

30500 

D 

0 

10 

19 

-0.73 

0.50 

0.77 

-0.49 

30501 

* 

-1 

4722 

95 

1.16 

0.02 

0.00 

-0.14 

30501 

A 

1 

165 

61 

2.40 

0.11 

1.18 

0.38 

30501 

B 

0 

25 

9 

1.18 

0.21 

0.96 

-0.18 

30501 

C 

0 

81 

30 

1.37 

0.13 

1.37 

-0.27 

30501 

D 

0 

1 

0 

-2.67 

0.00 

0.01 

-0.20 

30502 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.03 

30502 

A 

1 

38 

69 

1.07 

0.22 

1.13 

0.29 

30502 

B 

0 

13 

24 

0.40 

0.33 

2.01 

-0.17 

30502 

C 

0 

3 

5 

-0.32 

0.69 

0.73 

-0.20 

30502 

D 

0 

1 

2 

-0.38 

0.00 

0.42 

-0.12 

30503 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30503 

A 

1 

49 

88 

1.03 

0.15 

0.91 

0.39 

30503 

B 

0 

1 

2 

-0.59 

0.00 

0.34 

-0.18 

30503 

C 

0 

1 

2 

-0.74 

0.00 

0.30 

-0.20 

30503 

D 

0 

5 

9 

-0.12 

0.56 

0.81 

-0.28 

30504 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.04 

30504 

A 

1 

39 

71 

0.95 

0.19 

1.15 

0.30 

30504 

B 

0 

5 

9 

0.03 

0.29 

0.75 

-0.20 

30504 

C 

0 

3 

5 

0.60 

0.25 

1.16 

-0.03 

30504 

D 

0 

8 

15 

0.20 

0.32 

1.00 

-0.20 

30505 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.03 

30505 

A 

1 

30 

56 

1.35 

0.19 

0.84 

0.56 

30505 

B 

0 

14 

26 

-0.02 

0.22 

0.70 

-0.42 

30505 

C 

0 

6 

11 

0.26 

0.51 

1.27 

-0.16 

30505 

D 

0 

4 

7 

0.19 

0.17 

0.63 

-0.15 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30506 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.05 

30506 

A 

1 

31 

56 

0.99 

0.18 

1.08 

0.37 

30506 

B 

0 

3 

5 

-0.44 

0.77 

0.63 

-0.23 

30506 

C 

0 

14 

25 

0.51 

0.22 

1.27 

-0.06 

30506 

D 

0 

7 

13 

-0.34 

0.53 

0.93 

-0.33 

30507 

* 

-1 

4922 

99 

1.21 

0.02 

0.00 

0.03 

30507 

A 

1 

56 

78 

1.17 

0.16 

1.04 

0.42 

30507 

B 

0 

9 

13 

-0.01 

0.33 

0.84 

-0.28 

30507 

C 

0 

1 

1 

-0.76 

0.00 

0.27 

-0.16 

30507 

D 

0 

6 

8 

0.00 

0.27 

0.68 

-0.22 

30508 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30508 

A 

1 

31 

55 

1.57 

0.22 

0.88 

0.55 

30508 

B 

0 

17 

30 

0.24 

0.21 

0.88 

-0.27 

30508 

C 

0 

6 

11 

-0.47 

0.77 

0.60 

-0.31 

30508 

D 

0 

2 

4 

-1.29 

0.36 

0.14 

-0.28 

30509 

* 

-1 

4601 

92 

1.14 

0.02 

0.00 

-0.17 

30509 

A 

1 

368 

94 

2.08 

0.07 

1.00 

0.31 

30509 

B 

0 

9 

2 

0.28 

0.26 

0.48 

-0.19 

30509 

C 

0 

15 

4 

0.45 

0.31 

0.98 

-0.22 

30509 

D 

0 

1 

0 

-0.93 

0.00 

0.11 

-0.10 

30510 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.04 

30510 

A 

1 

33 

55 

1.16 

0.20 

0.95 

0.41 

30510 

B 

0 

19 

32 

0.46 

0.19 

1.18 

-0.15 

30510 

C 

0 

4 

7 

-0.19 

0.44 

0.59 

-0.21 

30510 

D 

0 

4 

7 

-0.72 

0.76 

0.52 

-0.32 

30511 

* 

-1 

4947 

99 

1.21 

0.02 

0.00 

0.03 

30511 

A 

1 

41 

87 

1.06 

0.15 

0.91 

0.51 

30511 

B 

0 

2 

4 

-0.54 

0.35 

0.34 

-0.20 

30511 

C 

0 

1 

2 

-0.80 

0.00 

0.25 

-0.17 

30511 

D 

0 

3 

6 

-1.46 

2.15 

1.28 

-0.43 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30512 

* 

-1 

4945 

99 

1.21 

0.02 

0.00 

0.02 

30512 

A 

1 

44 

90 

0.99 

0.15 

0.92 

0.33 

30512 

B 

0 

3 

6 

-0.13 

0.85 

1.07 

-0.25 

30512 

C 

0 

1 

2 

-0.73 

0.00 

0.29 

-0.23 

30512 

D 

0 

1 

2 

0.48 

0.00 

0.97 

-0.06 

30513 

* 

-1 

4944 

99 

1.21 

0.02 

0.00 

0.04 

30513 

A 

1 

44 

88 

0.74 

0.15 

1.12 

0.18 

30513 

B 

0 

1 

2 

0.01 

0.00 

0.73 

-0.09 

30513 

C 

0 

2 

4 

0.26 

0.49 

1.05 

-0.08 

30513 

D 

0 

3 

6 

0.19 

0.58 

1.14 

-0.12 

30514 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.03 

30514 

A 

1 

46 

84 

0.98 

0.14 

1.05 

0.23 

30514 

B 

0 

3 

5 

0.89 

0.45 

1.57 

0.00 

30514 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30514 

D 

0 

6 

11 

0.14 

0.29 

0.75 

-0.28 

30515 

* 

-1 

4943 

99 

1.21 

0.02 

0.00 

0.03 

30515 

A 

1 

42 

82 

0.98 

0.12 

0.84 

0.49 

30515 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30515 

C 

0 

6 

12 

-0.07 

0.34 

0.77 

-0.34 

30515 

D 

0 

3 

6 

-0.40 

0.42 

0.47 

-0.33 

30516 

* 

-1 

4944 

99 

1.21 

0.02 

0.00 

0.02 

30516 

A 

1 

41 

82 

1.13 

0.18 

1.01 

0.38 

30516 

B 

0 

3 

6 

-0.38 

0.37 

0.46 

-0.28 

30516 

C 

0 

3 

6 

0.55 

0.76 

1.78 

-0.08 

30516 

D 

0 

3 

6 

-0.29 

0.21 

0.47 

-0.26 

30517 

* 

-1 

4948 

99 

1.21 

0.02 

0.00 

0.04 

30517 

A 

1 

39 

85 

0.84 

0.16 

0.85 

0.47 

30517 

B 

0 

1 

2 

-0.75 

0.00 

0.38 

-0.16 

30517 

C 

0 

2 

4 

-0.39 

1.01 

0.85 

-0.17 

30517 

D 

0 

4 

9 

-0.97 

1.05 

0.70 

-0.39 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30518 

* 

-1 

4959 

99 

1.21 

0.02 

0.00 

0.00 

30518 

A 

1 

33 

94 

1.21 

0.21 

1.05 

0.19 

30518 

B 

0 

1 

3 

0.72 

0.00 

1.12 

-0.06 

30518 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30518 

D 

0 

1 

3 

-0.29 

0.00 

0.41 

-0.21 

30519 

* 

-1 

4951 

99 

1.21 

0.02 

0.00 

0.03 

30519 

A 

1 

36 

84 

0.91 

0.15 

1.04 

0.30 

30519 

B 

0 

3 

7 

0.04 

0.25 

0.62 

-0.25 

30519 

C 

0 

2 

5 

0.59 

0.46 

1.14 

-0.05 

30519 

D 

0 

2 

5 

0.13 

0.24 

0.66 

-0.17 

30520 

* 

-1 

4949 

99 

1.21 

0.02 

0.00 

0.04 

30520 

A 

1 

40 

89 

0.83 

0.14 

1.17 

0.45 

30520 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30520 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30520 

D 

0 

5 

11 

-0.58 

0.40 

0.54 

-0.45 

30521 

* 

-1 

4930 

99 

1.21 

0.02 

0.00 

0.03 

30521 

A 

1 

32 

50 

1.37 

0.24 

1.33 

0.43 

30521 

B 

0 

27 

42 

0.33 

0.17 

0.94 

-0.33 

30521 

C 

0 

3 

5 

0.31 

0.92 

1.30 

-0.09 

30521 

D 

0 

2 

3 

-0.34 

0.60 

0.39 

-0.17 

30522 

* 

-1 

4932 

99 

1.21 

0.02 

0.00 

0.03 

30522 

A 

1 

19 

31 

1.58 

0.23 

0.97 

0.46 

30522 

B 

0 

17 

27 

0.59 

0.24 

0.96 

-0.15 

30522 

C 

0 

11 

18 

0.53 

0.30 

0.91 

-0.14 

30522 

D 

0 

15 

24 

0.42 

0.24 

0.77 

-0.22 

30523 

* 

-1 

4926 

99 

1.21 

0.02 

0.00 

0.04 

30523 

A 

1 

32 

47 

1.11 

0.21 

1.22 

0.32 

30523 

B 

0 

2 

3 

1.29 

0.17 

1.74 

0.09 

30523 

C 

0 

19 

28 

0.55 

0.20 

1.13 

-0.12 

30523 

D 

0 

15 

22 

0.16 

0.24 

0.79 

-0.29 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30524 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.02 

30524 

A 

1 

4 

7 

1.43 

0.94 

4.20 

0.12 

30524 

B 

0 

1 

2 

0.04 

0.00 

0.24 

-0.10 

30524 

C 

0 

44 

79 

1.04 

0.17 

1.16 

0.19 

30524 

D 

0 

7 

13 

0.06 

0.25 

0.30 

-0.29 

30525 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.05 

30525 

A 

1 

52 

93 

0.67 

0.15 

0.95 

0.30 

30525 

B 

0 

2 

4 

-0.58 

0.52 

0.52 

-0.21 

30525 

C 

0 

1 

2 

-0.30 

0.00 

0.60 

-0.11 

30525 

D 

0 

1 

2 

-0.76 

0.00 

0.38 

-0.17 

30526 

* 

-1 

4942 

99 

1.21 

0.02 

0.00 

0.01 

30526 

A 

1 

45 

87 

1.19 

0.16 

1.01 

0.33 

30526 

B 

0 

2 

4 

0.11 

0.33 

0.59 

-0.18 

30526 

C 

0 

2 

4 

0.81 

0.22 

1.16 

-0.05 

30526 

D 

0 

3 

6 

-0.22 

0.44 

0.48 

-0.30 

30527 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.02 

30527 

A 

1 

40 

71 

1.26 

0.16 

0.90 

0.50 

30527 

B 

0 

1 

2 

-0.55 

0.00 

0.28 

-0.19 

30527 

C 

0 

14 

25 

0.13 

0.18 

0.68 

-0.44 

30527 

D 

0 

1 

2 

0.24 

0.00 

0.63 

-0.09 

30528 

* 

-1 

4700 

94 

1.17 

0.02 

0.00 

-0.12 

30528 

A 

1 

279 

95 

1.93 

0.07 

0.97 

0.29 

30528 

B 

0 

12 

4 

0.10 

0.20 

0.40 

-0.29 

30528 

C 

0 

3 

1 

1.18 

0.62 

1.28 

-0.05 

30528 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30529 

* 

-1 

4932 

99 

1.21 

0.02 

0.00 

0.05 

30529 

A 

1 

47 

76 

0.85 

0.13 

0.89 

0.47 

30529 

B 

0 

5 

8 

-0.25 

0.28 

0.60 

-0.28 

30529 

C 

0 

10 

16 

-0.10 

0.19 

0.71 

-0.34 

30529 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30530 

* 

-1 

4940 

99 

1.22 

0.02 

0.00 

0.07 

30530 

A 

1 

27 

50 

0.99 

0.18 

0.84 

0.50 

30530 

B 

0 

11 

20 

-0.53 

0.25 

0.53 

-0.34 

30530 

C 

0 

12 

22 

0.43 

0.28 

1.73 

0.03 

30530 

D 

0 

4 

7 

-1.86 

0.90 

0.21 

-0.48 

30531 

* 

-1 

4702 

94 

1.17 

0.02 

0.00 

-0.10 

30531 

A 

1 

160 

55 

2.42 

0.10 

1.00 

0.55 

30531 

B 

0 

12 

4 

0.95 

0.30 

0.86 

-0.12 

30531 

C 

0 

109 

37 

1.04 

0.08 

0.72 

-0.40 

30531 

D 

0 

11 

4 

-0.29 

0.45 

0.25 

-0.30 

30532 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30532 

A 

1 

3 

5 

1.79 

0.89 

1.19 

0.22 

30532 

B 

0 

6 

11 

0.98 

0.24 

0.93 

0.06 

30532 

C 

0 

37 

66 

0.90 

0.14 

1.02 

0.13 

30532 

D 

0 

10 

18 

0.05 

0.48 

0.68 

-0.33 

30533 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.01 

30533 

A 

1 

12 

22 

1.74 

0.40 

1.56 

0.32 

30533 

B 

0 

10 

19 

1.67 

0.36 

2.01 

0.26 

30533 

C 

0 

6 

11 

0.03 

0.55 

0.57 

-0.30 

30533 

D 

0 

26 

48 

0.69 

0.16 

0.69 

-0.28 

30534 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

30534 

A 

1 

7 

13 

2.33 

0.66 

0.70 

0.50 

30534 

B 

0 

32 

57 

0.63 

0.14 

0.90 

-0.08 

30534 

C 

0 

9 

16 

0.69 

0.38 

1.33 

-0.01 

30534 

D 

0 

8 

14 

-0.32 

0.41 

0.42 

-0.34 

30535 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.02 

30535 

A 

1 

34 

61 

1.30 

0.17 

1.39 

0.45 

30535 

B 

0 

10 

18 

0.35 

0.29 

0.88 

-0.25 

30535 

C 

0 

9 

16 

0.47 

0.30 

0.99 

-0.19 

30535 

D 

0 

3 

5 

-0.20 

0.40 

0.42 

-0.25 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30536 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30536 

A 

1 

37 

66 

1.28 

0.22 

1.04 

0.47 

30536 

B 

0 

7 

13 

-0.19 

0.26 

0.59 

-0.31 

30536 

C 

0 

3 

5 

0.56 

0.63 

1.39 

-0.05 

30536 

D 

0 

9 

16 

-0.01 

0.20 

0.67 

-0.29 

30537 

* 

-1 

4930 

99 

1.21 

0.02 

0.00 

0.04 

30537 

A 

1 

8 

13 

1.09 

0.45 

1.92 

0.12 

30537 

B 

0 

41 

64 

0.84 

0.14 

1.13 

0.08 

30537 

C 

0 

8 

13 

0.93 

0.40 

1.34 

0.06 

30537 

D 

0 

7 

11 

-0.08 

0.34 

0.39 

-0.31 

30538 

* 

-1 

4933 

99 

1.21 

0.02 

0.00 

0.04 

30538 

A 

1 

35 

57 

1.33 

0.14 

0.73 

0.58 

30538 

B 

0 

12 

20 

0.04 

0.21 

0.64 

-0.30 

30538 

C 

0 

8 

13 

0.46 

0.25 

0.95 

-0.10 

30538 

D 

0 

6 

10 

-0.87 

0.73 

0.50 

-0.45 

30539 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.05 

30539 

A 

1 

40 

73 

1.17 

0.21 

0.78 

0.58 

30539 

B 

0 

9 

16 

-0.35 

0.18 

0.66 

-0.27 

30539 

C 

0 

2 

4 

-1.64 

0.45 

0.17 

-0.28 

30539 

D 

0 

4 

7 

-1.65 

0.92 

0.35 

-0.41 

30540 

* 

-1 

4933 

99 

1.21 

0.02 

0.00 

0.05 

30540 

A 

1 

38 

62 

1.21 

0.17 

0.87 

0.56 

30540 

B 

0 

13 

21 

-0.06 

0.22 

0.72 

-0.23 

30540 

C 

0 

3 

5 

0.19 

0.25 

0.75 

-0.06 

30540 

D 

0 

7 

11 

-1.40 

0.79 

0.36 

-0.50 

30541 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.05 

30541 

A 

1 

12 

20 

0.48 

0.34 

2.62 

-0.03 

30541 

B 

0 

23 

39 

1.18 

0.24 

2.11 

0.41 

30541 

C 

0 

16 

27 

0.27 

0.24 

0.75 

-0.14 

30541 

D 

0 

8 

14 

-0.58 

0.41 

0.39 

-0.37 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30542 

* 

-1 

4931 

99 

1.21 

0.02 

0.00 

0.04 

30542 

A 

1 

51 

81 

0.93 

0.13 

0.98 

0.33 

30542 

B 

0 

4 

6 

0.79 

0.14 

1.34 

0.00 

30542 

C 

0 

5 

8 

0.23 

0.14 

0.78 

-0.16 

30542 

D 

0 

3 

5 

-1.07 

0.87 

0.37 

-0.41 

30543 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.05 

30543 

A 

1 

8 

14 

0.51 

0.40 

2.61 

-0.05 

30543 

B 

0 

1 

2 

1.96 

0.00 

2.73 

0.17 

30543 

C 

0 

30 

53 

0.83 

0.17 

1.27 

0.21 

30543 

D 

0 

18 

32 

0.27 

0.25 

0.79 

-0.24 

30544 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

30544 

A 

1 

53 

93 

0.86 

0.14 

0.87 

0.48 

30544 

B 

0 

2 

4 

-1.29 

0.01 

0.22 

-0.34 

30544 

C 

0 

1 

2 

-0.86 

0.00 

0.35 

-0.19 

30544 

D 

0 

1 

2 

-1.42 

0.00 

0.20 

-0.26 

30545 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.05 

30545 

A 

1 

47 

84 

0.85 

0.13 

0.77 

0.54 

30545 

B 

0 

3 

5 

-0.87 

0.77 

0.58 

-0.31 

30545 

C 

0 

1 

2 

-1.42 

0.00 

0.19 

-0.24 

30545 

D 

0 

5 

9 

-0.58 

0.55 

0.66 

-0.33 

30546 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.03 

30546 

A 

1 

12 

22 

1.24 

0.41 

2.04 

0.20 

30546 

B 

0 

19 

35 

0.68 

0.35 

1.32 

-0.05 

30546 

C 

0 

5 

9 

1.28 

0.21 

1.26 

0.13 

30546 

D 

0 

19 

35 

0.41 

0.22 

0.71 

-0.20 

30547 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.02 

30547 

A 

1 

53 

88 

1.12 

0.12 

0.83 

0.44 

30547 

B 

0 

2 

3 

0.53 

0.50 

1.05 

-0.08 

30547 

C 

0 

3 

5 

-0.71 

1.08 

0.82 

-0.37 

30547 

D 

0 

2 

3 

-0.42 

0.41 

0.39 

-0.25 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30548 

* 

-1 

4933 

99 

1.21 

0.02 

0.00 

0.05 

30548 

A 

1 

11 

18 

0.99 

0.40 

2.16 

0.15 

30548 

B 

0 

9 

15 

0.29 

0.27 

0.66 

-0.15 

30548 

C 

0 

24 

39 

0.73 

0.20 

1.26 

0.06 

30548 

D 

0 

17 

28 

0.53 

0.25 

1.10 

-0.07 

30549 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.03 

30549 

A 

1 

51 

88 

0.98 

0.16 

0.91 

0.39 

30549 

B 

0 

2 

3 

-0.67 

0.18 

0.37 

-0.24 

30549 

C 

0 

1 

2 

0.83 

0.00 

1.64 

0.00 

30549 

D 

0 

4 

7 

-0.66 

0.56 

0.55 

-0.34 

30550 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.05 

30550 

A 

1 

29 

52 

1.15 

0.19 

0.95 

0.46 

30550 

B 

0 

13 

23 

0.48 

0.33 

1.44 

-0.06 

30550 

C 

0 

5 

9 

-0.09 

0.33 

0.59 

-0.18 

30550 

D 

0 

9 

16 

-0.52 

0.33 

0.45 

-0.41 

30551 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.05 

30551 

A 

1 

52 

96 

0.63 

0.11 

0.62 

0.57 

30551 

B 

0 

1 

2 

-0.70 

0.00 

0.58 

-0.16 

30551 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30551 

D 

0 

1 

2 

-4.46 

0.00 

0.01 

-0.64 

30552 

* 

-1 

4952 

99 

1.21 

0.02 

0.00 

0.03 

30552 

A 

1 

38 

90 

0.87 

0.16 

0.98 

0.28 

30552 

B 

0 

1 

2 

-0.64 

0.00 

0.33 

-0.24 

30552 

C 

0 

3 

7 

0.18 

0.25 

0.79 

-0.18 

30552 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30553 

* 

-1 

4953 

99 

1.21 

0.02 

0.00 

0.04 

30553 

A 

1 

40 

98 

0.72 

0.19 

0.90 

0.30 

30553 

B 

0 

1 

2 

-1.63 

0.00 

0.17 

-0.30 

30553 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30553 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30554 

* 

-1 

4953 

99 

1.21 

0.02 

0.00 

0.02 

30554 

A 

1 

33 

80 

1.07 

0.19 

1.07 

0.34 

30554 

B 

0 

1 

2 

-1.11 

0.00 

0.18 

-0.29 

30554 

C 

0 

3 

7 

0.35 

0.43 

0.91 

-0.14 

30554 

D 

0 

4 

10 

0.34 

0.28 

0.86 

-0.17 

30555 

* 

-1 

4943 

99 

1.21 

0.02 

0.00 

0.04 

30555 

A 

1 

42 

82 

0.84 

0.17 

1.01 

0.33 

30555 

B 

0 

1 

2 

0.84 

0.00 

1.67 

0.02 

30555 

C 

0 

6 

12 

-0.14 

0.33 

0.82 

-0.27 

30555 

D 

0 

2 

4 

-0.54 

0.41 

0.45 

-0.22 

30556 

* 

-1 

4949 

99 

1.21 

0.02 

0.00 

0.04 

30556 

A 

1 

39 

87 

0.91 

0.19 

1.04 

0.43 

30556 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30556 

C 

0 

3 

7 

-0.25 

0.63 

0.73 

-0.16 

30556 

D 

0 

3 

7 

-1.75 

2.07 

0.96 

-0.43 

30557 

* 

-1 

4952 

99 

1.21 

0.02 

0.00 

0.03 

30557 

A 

1 

37 

88 

0.96 

0.16 

0.86 

0.44 

30557 

B 

0 

2 

5 

-0.63 

0.45 

0.37 

-0.31 

30557 

C 

0 

3 

7 

-0.29 

0.50 

0.59 

-0.30 

30557 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30558 

* 

-1 

4949 

99 

1.21 

0.02 

0.00 

0.02 

30558 

A 

1 

43 

96 

0.92 

0.14 

1.02 

0.03 

30558 

B 

0 

1 

2 

1.80 

0.00 

3.45 

0.14 

30558 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30558 

D 

0 

1 

2 

-0.23 

0.00 

0.45 

-0.19 

30559 

* 

-1 

4956 

99 

1.21 

0.02 

0.00 

0.03 

30559 

A 

1 

33 

87 

0.96 

0.14 

0.85 

0.47 

30559 

B 

0 

2 

5 

-1.21 

0.41 

0.19 

-0.52 

30559 

C 

0 

2 

5 

0.32 

0.06 

0.82 

-0.12 

30559 

D 

0 

1 

3 

0.29 

0.00 

0.80 

-0.09 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30560 

* 

-1 

4948 

99 

1.21 

0.02 

0.00 

0.03 

30560 

A 

1 

41 

89 

0.97 

0.16 

0.86 

0.48 

30560 

B 

0 

4 

9 

-0.84 

0.27 

0.33 

-0.45 

30560 

C 

0 

1 

2 

-0.47 

0.00 

0.43 

-0.17 

30560 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30561 

* 

-1 

4947 

99 

1.21 

0.02 

0.00 

0.03 

30561 

A 

1 

35 

74 

0.95 

0.16 

1.01 

0.32 

30561 

B 

0 

10 

21 

0.32 

0.36 

1.85 

-0.22 

30561 

C 

0 

1 

2 

-0.61 

0.00 

0.32 

-0.20 

30561 

D 

0 

1 

2 

-0.22 

0.00 

0.48 

-0.14 

30562 

* 

-1 

4945 

99 

1.21 

0.02 

0.00 

0.05 

30562 

A 

1 

26 

53 

0.56 

0.24 

1.75 

0.09 

30562 

B 

0 

8 

16 

0.20 

0.26 

1.14 

-0.10 

30562 

C 

0 

15 

31 

0.45 

0.31 

2.13 

-0.01 

30562 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30563 

* 

-1 

4950 

99 

1.21 

0.02 

0.00 

0.02 

30563 

A 

1 

41 

93 

1.03 

0.18 

1.03 

0.15 

30563 

B 

0 

3 

7 

0.36 

0.58 

1.09 

-0.15 

30563 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30563 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30564 

* 

-1 

4946 

99 

1.21 

0.02 

0.00 

0.05 

30564 

A 

1 

27 

56 

1.09 

0.26 

0.98 

0.45 

30564 

B 

0 

6 

13 

0.08 

0.16 

0.78 

-0.14 

30564 

C 

0 

3 

6 

0.72 

0.55 

1.90 

0.03 

30564 

D 

0 

12 

25 

-0.43 

0.32 

0.70 

-0.43 

30565 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.00 

30565 

A 

1 

43 

72 

1.44 

0.17 

0.99 

0.39 

30565 

B 

0 

11 

18 

0.49 

0.22 

0.80 

-0.29 

30565 

C 

0 

1 

2 

0.47 

0.00 

0.63 

-0.08 

30565 

D 

0 

5 

8 

0.44 

0.67 

1.14 

-0.20 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30566 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.02 

30566 

A 

1 

43 

77 

1.25 

0.16 

1.28 

0.49 

30566 

B 

0 

4 

7 

-0.21 

0.35 

0.48 

-0.28 

30566 

C 

0 

3 

5 

0.19 

0.07 

0.62 

-0.16 

30566 

D 

0 

6 

11 

-0.13 

0.45 

0.70 

-0.32 

30567 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30567 

A 

1 

24 

43 

0.94 

0.22 

1.54 

0.11 

30567 

B 

0 

15 

27 

0.96 

0.21 

1.45 

0.09 

30567 

C 

0 

3 

5 

0.13 

0.50 

0.57 

-0.15 

30567 

D 

0 

14 

25 

0.55 

0.34 

1.20 

-0.14 

30568 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.01 

30568 

A 

1 

37 

69 

1.52 

0.17 

0.88 

0.55 

30568 

B 

0 

2 

4 

-0.67 

1.80 

0.67 

-0.28 

30568 

C 

0 

2 

4 

-0.06 

0.52 

0.45 

-0.18 

30568 

D 

0 

13 

24 

0.23 

0.21 

0.64 

-0.39 

30569 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.02 

30569 

A 

1 

34 

60 

1.41 

0.16 

0.81 

0.50 

30569 

B 

0 

3 

5 

0.80 

0.38 

1.09 

-0.02 

30569 

C 

0 

2 

4 

0.23 

1.18 

0.96 

-0.10 

30569 

D 

0 

18 

32 

0.03 

0.33 

0.84 

-0.47 

30570 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30570 

A 

1 

44 

79 

1.12 

0.11 

0.85 

0.56 

30570 

B 

0 

2 

4 

0.37 

0.11 

0.71 

-0.12 

30570 

C 

0 

5 

9 

0.03 

0.14 

0.53 

-0.33 

30570 

D 

0 

5 

9 

-0.15 

0.34 

0.52 

-0.40 

30571 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.03 

30571 

A 

1 

45 

76 

1.10 

0.18 

1.19 

0.38 

30571 

B 

0 

2 

3 

0.17 

0.30 

0.73 

-0.09 

30571 

C 

0 

5 

8 

0.17 

0.43 

1.04 

-0.15 

30571 

D 

0 

7 

12 

-0.34 

0.71 

1.02 

-0.32 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30572 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.04 

30572 

A 

1 

39 

67 

0.98 

0.14 

0.98 

0.43 

30572 

B 

0 

7 

12 

0.63 

0.25 

1.25 

-0.02 

30572 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30572 

D 

0 

12 

21 

-0.28 

0.31 

0.64 

-0.49 

30573 

* 

-1 

4931 

99 

1.21 

0.02 

0.00 

0.02 

30573 

A 

1 

36 

57 

1.33 

0.18 

1.02 

0.43 

30573 

B 

0 

3 

5 

1.00 

0.46 

1.42 

0.01 

30573 

C 

0 

13 

21 

0.61 

0.15 

0.88 

-0.17 

30573 

D 

0 

11 

17 

0.10 

0.18 

0.55 

-0.39 

30574 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.04 

30574 

A 

1 

27 

49 

1.31 

0.22 

0.81 

0.54 

30574 

B 

0 

5 

9 

0.16 

0.68 

1.99 

-0.13 

30574 

C 

0 

10 

18 

0.14 

0.24 

0.78 

-0.21 

30574 

D 

0 

13 

24 

-0.12 

0.21 

0.60 

-0.36 

30575 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.01 

30575 

A 

1 

34 

58 

1.45 

0.18 

1.07 

0.35 

30575 

B 

0 

15 

25 

0.71 

0.27 

1.19 

-0.20 

30575 

C 

0 

4 

7 

0.45 

0.67 

0.96 

-0.16 

30575 

D 

0 

6 

10 

0.61 

0.60 

1.18 

-0.15 

30576 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.03 

30576 

A 

1 

35 

59 

1.33 

0.15 

0.81 

0.51 

30576 

B 

0 

8 

14 

0.63 

0.29 

1.21 

-0.07 

30576 

C 

0 

6 

10 

0.47 

0.43 

1.08 

-0.10 

30576 

D 

0 

10 

17 

-0.58 

0.42 

0.49 

-0.53 

30579 

* 

-1 

4945 

99 

1.21 

0.02 

0.00 

0.05 

30579 

A 

1 

46 

94 

0.64 

0.13 

0.95 

0.33 

30579 

B 

0 

1 

2 

-1.25 

0.00 

0.23 

-0.30 

30579 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30579 

D 

0 

2 

4 

-0.21 

0.35 

0.68 

-0.18 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30580 

* 

-1 

4946 

99 

1.21 

0.02 

0.00 

0.03 

30580 

A 

1 

39 

81 

0.82 

0.19 

1.05 

0.16 

30580 

B 

0 

3 

6 

0.07 

0.75 

1.08 

-0.15 

30580 

C 

0 

4 

8 

-0.02 

0.36 

0.81 

-0.20 

30580 

D 

0 

2 

4 

1.48 

1.24 

5.59 

0.13 

30583 

* 

-1 

4946 

99 

1.21 

0.02 

0.00 

0.01 

30583 

A 

1 

44 

92 

1.17 

0.18 

0.99 

0.17 

30583 

B 

0 

1 

2 

0.90 

0.00 

1.43 

-0.02 

30583 

C 

0 

2 

4 

1.08 

1.69 

4.83 

0.00 

30583 

D 

0 

1 

2 

-1.42 

0.00 

0.14 

-0.29 

30584 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

30584 

A 

1 

49 

86 

0.89 

0.14 

0.89 

0.37 

30584 

B 

0 

1 

2 

1.48 

0.00 

3.05 

0.09 

30584 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30584 

D 

0 

7 

12 

-0.52 

0.43 

0.67 

-0.43 

30585 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.04 

30585 

A 

1 

50 

86 

0.82 

0.16 

1.11 

0.22 

30585 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30585 

C 

0 

2 

3 

0.43 

1.05 

1.74 

-0.05 

30585 

D 

0 

6 

10 

0.00 

0.20 

0.78 

-0.22 

30586 

* 

-1 

4932 

99 

1.21 

0.02 

0.00 

0.03 

30586 

A 

1 

36 

58 

1.06 

0.16 

1.23 

0.20 

30586 

B 

0 

6 

10 

0.31 

0.42 

0.83 

-0.20 

30586 

C 

0 

16 

26 

0.85 

0.26 

1.53 

-0.03 

30586 

D 

0 

4 

6 

0.53 

0.29 

0.81 

-0.10 

30587 

* 

-1 

4945 

99 

1.21 

0.02 

0.00 

0.03 

30587 

A 

1 

43 

88 

0.89 

0.15 

0.98 

0.32 

30587 

B 

0 

3 

6 

0.10 

0.07 

0.75 

-0.16 

30587 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30587 

D 

0 

3 

6 

-0.36 

0.85 

1.00 

-0.28 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30588 

* 

-1 

4932 

99 

1.21 

0.02 

0.00 

0.01 

30588 

A 

1 

58 

94 

1.14 

0.12 

1.00 

0.21 

30588 

B 

0 

1 

2 

1.03 

0.00 

1.36 

-0.01 

30588 

C 

0 

2 

3 

0.08 

0.72 

0.67 

-0.20 

30588 

D 

0 

1 

2 

0.11 

0.00 

0.54 

-0.13 

30589 

* 

-1 

4947 

99 

1.21 

0.02 

0.00 

0.03 

30589 

A 

1 

45 

96 

0.79 

0.19 

2.00 

0.11 

30589 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30589 

C 

0 

2 

4 

0.08 

0.82 

1.56 

-0.11 

30589 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30590 

* 

-1 

4952 

99 

1.21 

0.02 

0.00 

0.03 

30590 

A 

1 

40 

95 

0.86 

0.15 

1.01 

0.23 

30590 

B 

0 

1 

2 

0.38 

0.00 

0.96 

-0.07 

30590 

C 

0 

1 

2 

-0.71 

0.00 

0.33 

-0.26 

30590 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30591 

* 

-1 

4944 

99 

1.21 

0.02 

0.00 

0.02 

30591 

A 

1 

49 

98 

0.91 

0.15 

1.01 

0.23 

30591 

B 

0 

1 

2 

-0.84 

0.00 

0.31 

-0.23 

30591 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30591 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30592 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.04 

30592 

A 

1 

51 

93 

0.71 

0.18 

1.15 

0.06 

30592 

B 

0 

2 

4 

0.59 

0.42 

1.82 

-0.01 

30592 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30592 

D 

0 

2 

4 

0.28 

0.98 

1.85 

-0.06 

30593 

* 

-1 

4956 

99 

1.21 

0.02 

0.00 

0.03 

30593 

A 

1 

30 

79 

0.91 

0.22 

1.27 

0.21 

30593 

B 

0 

4 

11 

0.14 

0.24 

0.77 

-0.20 

30593 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30593 

D 

0 

4 

11 

0.51 

0.54 

1.51 

-0.08 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30594 

* 

-1 

4954 

99 

1.21 

0.02 

0.00 

0.00 

30594 

A 

1 

38 

95 

1.17 

0.15 

1.03 

0.14 

30594 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30594 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30594 

D 

0 

2 

5 

0.58 

0.29 

0.84 

-0.14 

30595 

* 

-1 

4959 

99 

1.21 

0.02 

0.00 

0.02 

30595 

A 

-1 

35 

100 

0.84 

0.17 

0.00 

0.00 

30595 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30595 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30595 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30596 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

30596 

A 

1 

44 

79 

1.02 

0.17 

0.83 

0.50 

30596 

B 

0 

3 

5 

-0.31 

0.14 

0.51 

-0.20 

30596 

C 

0 

2 

4 

-0.30 

0.28 

0.52 

-0.16 

30596 

D 

0 

7 

13 

-0.52 

0.39 

0.59 

-0.39 

30597 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.04 

30597 

A 

1 

50 

86 

1.08 

0.14 

0.85 

0.57 

30597 

B 

0 

1 

2 

-1.09 

0.00 

0.21 

-0.18 

30597 

C 

0 

4 

7 

-0.27 

0.38 

0.57 

-0.20 

30597 

D 

0 

3 

5 

-2.59 

1.60 

0.27 

-0.56 

30598 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.04 

30598 

A 

1 

48 

89 

0.83 

0.17 

0.92 

0.31 

30598 

B 

0 

5 

9 

-0.49 

1.02 

1.51 

-0.29 

30598 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30598 

D 

0 

1 

2 

-0.25 

0.00 

0.64 

-0.10 

30599 

* 

-1 

4951 

99 

1.21 

0.02 

0.00 

0.02 

30599 

A 

1 

35 

81 

1.08 

0.16 

0.96 

0.40 

30599 

B 

0 

2 

5 

-0.15 

0.64 

0.56 

-0.24 

30599 

C 

0 

3 

7 

-0.29 

0.28 

0.43 

-0.33 

30599 

D 

0 

3 

7 

0.61 

0.49 

1.21 

-0.08 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30600 

* 

-1 

4956 

99 

1.21 

0.02 

0.00 

0.01 

30600 

A 

1 

34 

89 

1.09 

0.17 

1.24 

0.27 

30600 

B 

0 

1 

3 

-0.51 

0.00 

0.31 

-0.26 

30600 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30600 

D 

0 

3 

8 

0.50 

0.43 

1.00 

-0.15 

30601 

* 

-1 

4957 

99 

1.21 

0.02 

0.00 

0.04 

30601 

A 

1 

36 

97 

0.66 

0.17 

0.98 

0.25 

30601 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30601 

C 

0 

1 

3 

-0.91 

0.00 

0.34 

-0.25 

30601 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30602 

* 

-1 

4954 

99 

1.21 

0.02 

0.00 

0.03 

30602 

A 

1 

36 

90 

0.80 

0.15 

1.00 

0.25 

30602 

B 

0 

3 

8 

0.10 

0.65 

1.12 

-0.19 

30602 

C 

0 

1 

3 

-0.16 

0.00 

0.57 

-0.15 

30602 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30603 

* 

-1 

4946 

99 

1.21 

0.02 

0.00 

0.03 

30603 

A 

1 

47 

98 

0.82 

0.16 

0.95 

0.31 

30603 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30603 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30603 

D 

0 

1 

2 

-1.64 

0.00 

0.17 

-0.31 

30604 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.03 

30604 

A 

1 

56 

95 

0.98 

0.14 

0.86 

0.44 

30604 

B 

0 

1 

2 

-1.05 

0.00 

0.27 

-0.21 

30604 

C 

0 

1 

2 

-0.93 

0.00 

0.30 

-0.20 

30604 

D 

0 

1 

2 

-2.11 

0.00 

0.09 

-0.33 

30605 

* 

-1 

1957 

39 

1.87 

0.03 

0.00 

0.40 

30605 

A 

1 

2432 

80 

1.01 

0.02 

0.93 

0.42 

30605 

B 

0 

162 

5 

-0.24 

0.07 

0.78 

-0.21 

30605 

C 

0 

287 

9 

0.15 

0.05 

1.21 

-0.18 

30605 

D 

0 

156 

5 

-0.76 

0.10 

0.49 

-0.31 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30606 

* 

-1 

4954 

99 

1.21 

0.02 

0.00 

0.04 

30606 

A 

1 

33 

83 

0.86 

0.13 

0.73 

0.66 

30606 

B 

0 

3 

8 

-0.32 

0.44 

0.66 

-0.25 

30606 

C 

0 

3 

8 

-1.50 

0.08 

0.17 

-0.59 

30606 

D 

0 

1 

3 

-0.63 

0.00 

0.41 

-0.19 

30607 

* 

-1 

4947 

99 

1.21 

0.02 

0.00 

0.02 

30607 

A 

1 

29 

62 

1.50 

0.20 

0.91 

0.59 

30607 

B 

0 

2 

4 

-1.01 

0.97 

0.25 

-0.33 

30607 

C 

0 

13 

28 

0.22 

0.26 

0.90 

-0.35 

30607 

D 

0 

3 

6 

-0.26 

0.26 

0.38 

-0.25 

30608 

* 

-1 

4949 

99 

1.21 

0.02 

0.00 

0.03 

30608 

A 

1 

35 

78 

1.07 

0.17 

0.94 

0.44 

30608 

B 

0 

3 

7 

0.24 

0.58 

1.04 

-0.15 

30608 

C 

0 

5 

11 

-0.01 

0.29 

0.67 

-0.29 

30608 

D 

0 

2 

4 

-0.47 

0.16 

0.36 

-0.27 

30609 

* 

-1 

4961 

99 

1.21 

0.02 

0.00 

0.02 

30609 

A 

1 

29 

88 

1.03 

0.18 

0.83 

0.47 

30609 

B 

0 

3 

9 

-0.49 

0.38 

0.41 

-0.41 

30609 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30609 

D 

0 

1 

3 

-0.37 

0.00 

0.40 

-0.21 

30610 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30610 

A 

1 

51 

91 

0.92 

0.16 

0.92 

0.29 

30610 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30610 

C 

0 

2 

4 

0.81 

0.65 

1.96 

0.00 

30610 

D 

0 

2 

4 

-1.35 

0.18 

0.19 

-0.35 

30611 

* 

-1 

4944 

99 

1.21 

0.02 

0.00 

0.03 

30611 

A 

1 

33 

66 

1.32 

0.16 

0.75 

0.57 

30611 

B 

0 

9 

18 

0.24 

0.19 

0.76 

-0.17 

30611 

C 

0 

2 

4 

0.58 

0.32 

0.95 

-0.03 

30611 

D 

0 

6 

12 

-1.53 

0.90 

0.35 

-0.61 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30612 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.02 

30612 

A 

1 

51 

94 

0.96 

0.14 

1.01 

0.25 

30612 

B 

0 

2 

4 

0.34 

0.59 

1.10 

-0.11 

30612 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30612 

D 

0 

1 

2 

-1.17 

0.00 

0.21 

-0.27 

30613 

* 

-1 

4949 

99 

1.21 

0.02 

0.00 

0.03 

30613 

A 

1 

37 

82 

0.92 

0.18 

1.15 

0.26 

30613 

B 

0 

4 

9 

0.28 

0.21 

0.86 

-0.16 

30613 

C 

0 

1 

2 

0.30 

0.00 

0.81 

-0.08 

30613 

D 

0 

3 

7 

0.18 

0.34 

0.80 

-0.17 

30614 

* 

-1 

4930 

99 

1.21 

0.02 

0.00 

0.04 

30614 

A 

1 

35 

55 

0.98 

0.20 

1.69 

0.24 

30614 

B 

0 

9 

14 

0.89 

0.33 

1.66 

0.06 

30614 

C 

0 

12 

19 

0.42 

0.21 

1.04 

-0.14 

30614 

D 

0 

8 

13 

0.00 

0.38 

0.69 

-0.25 

30615 

* 

-1 

4949 

99 

1.21 

0.02 

0.00 

0.03 

30615 

A 

1 

29 

64 

0.89 

0.14 

1.05 

0.19 

30615 

B 

0 

11 

24 

0.65 

0.23 

1.25 

-0.10 

30615 

C 

0 

3 

7 

-0.09 

0.62 

0.62 

-0.30 

30615 

D 

0 

2 

4 

1.22 

0.15 

1.70 

0.12 

30616 

* 

-1 

4708 

94 

1.17 

0.02 

0.00 

-0.11 

30616 

A 

1 

272 

95 

1.89 

0.08 

0.95 

0.33 

30616 

B 

0 

8 

3 

0.12 

0.20 

0.45 

-0.21 

30616 

C 

0 

4 

1 

-0.58 

0.54 

0.27 

-0.21 

30616 

D 

0 

2 

1 

-0.62 

0.13 

0.19 

-0.15 

30617 

* 

-1 

4955 

99 

1.21 

0.02 

0.00 

0.01 

30617 

A 

1 

37 

95 

1.04 

0.15 

0.98 

0.15 

30617 

B 

0 

1 

3 

1.30 

0.00 

1.83 

0.05 

30617 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30617 

D 

0 

1 

3 

-0.46 

0.00 

0.31 

-0.25 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30618 

* 

-1 

4950 

99 

1.21 

0.02 

0.00 

0.05 

30618 

A 

1 

37 

84 

0.61 

0.16 

1.00 

0.34 

30618 

B 

0 

3 

7 

-0.67 

0.50 

0.54 

-0.31 

30618 

C 

0 

2 

5 

-0.18 

0.77 

0.92 

-0.14 

30618 

D 

0 

2 

5 

0.14 

0.09 

0.97 

-0.07 

30619 

* 

-1 

4956 

99 

1.21 

0.02 

0.00 

0.04 

30619 

A 

1 

32 

84 

0.61 

0.15 

1.12 

0.02 

30619 

B 

0 

2 

5 

0.67 

0.42 

1.42 

0.02 

30619 

C 

0 

1 

3 

-0.25 

0.00 

0.52 

-0.18 

30619 

D 

0 

3 

8 

0.78 

0.27 

1.56 

0.07 

30620 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.05 

30620 

A 

1 

46 

85 

0.76 

0.14 

0.96 

0.35 

30620 

B 

0 

1 

2 

-0.37 

0.00 

0.53 

-0.13 

30620 

C 

0 

4 

7 

0.63 

0.38 

1.78 

0.01 

30620 

D 

0 

3 

6 

-1.46 

0.33 

0.20 

-0.48 

30621 

* 

-1 

4947 

99 

1.21 

0.02 

0.00 

0.01 

30621 

A 

1 

45 

96 

1.22 

0.17 

1.02 

0.52 

30621 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30621 

C 

0 

1 

2 

0.58 

0.00 

0.84 

-0.05 

30621 

D 

0 

1 

2 

-5.70 

0.00 

0.00 

-0.67 

30622 

* 

-1 

1725 

35 

1.85 

0.03 

0.00 

0.35 

30622 

A 

1 

2720 

83 

1.07 

0.02 

0.98 

0.38 

30622 

B 

0 

176 

5 

0.03 

0.07 

1.12 

-0.17 

30622 

C 

0 

265 

8 

0.02 

0.05 

0.94 

-0.21 

30622 

D 

0 

108 

3 

-0.84 

0.13 

0.48 

-0.26 

30623 

* 

-1 

4927 

99 

1.21 

0.02 

0.00 

0.04 

30623 

A 

1 

59 

88 

0.92 

0.13 

0.88 

0.44 

30623 

B 

0 

1 

1 

0.60 

0.00 

1.32 

-0.02 

30623 

C 

0 

3 

4 

-0.47 

0.24 

0.48 

-0.24 

30623 

D 

0 

4 

6 

-0.95 

0.56 

0.43 

-0.38 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30624 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.02 

30624 

A 

1 

40 

71 

1.35 

0.16 

0.79 

0.55 

30624 

B 

0 

10 

18 

0.34 

0.15 

0.73 

-0.27 

30624 

C 

0 

5 

9 

-0.53 

0.36 

0.34 

-0.44 

30624 

D 

0 

1 

2 

-0.29 

0.00 

0.35 

-0.16 

30625 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.03 

30625 

A 

1 

40 

68 

1.36 

0.21 

0.80 

0.54 

30625 

B 

0 

8 

14 

-0.88 

0.42 

0.41 

-0.45 

30625 

C 

0 

6 

10 

0.19 

0.34 

0.93 

-0.14 

30625 

D 

0 

5 

8 

-0.17 

0.48 

0.79 

-0.20 

30626 

* 

-1 

4948 

99 

1.21 

0.02 

0.00 

0.03 

30626 

A 

1 

36 

78 

0.90 

0.15 

0.99 

0.35 

30626 

B 

0 

8 

17 

0.00 

0.31 

0.91 

-0.36 

30626 

C 

0 

2 

4 

0.54 

0.40 

1.12 

-0.04 

30626 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30627 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.02 

30627 

A 

1 

50 

88 

1.10 

0.13 

0.84 

0.40 

30627 

B 

0 

5 

9 

-0.15 

0.85 

2.34 

-0.31 

30627 

C 

0 

2 

4 

-0.43 

0.30 

0.40 

-0.24 

30627 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30628 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.02 

30628 

A 

1 

51 

89 

1.19 

0.16 

0.88 

0.41 

30628 

B 

0 

3 

5 

-0.60 

0.94 

0.67 

-0.31 

30628 

C 

0 

3 

5 

-0.27 

0.22 

0.48 

-0.25 

30628 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30629 

* 

-1 

4927 

99 

1.21 

0.02 

0.00 

0.01 

30629 

A 

1 

57 

85 

1.27 

0.16 

0.92 

0.44 

30629 

B 

0 

6 

9 

-0.10 

0.22 

0.57 

-0.29 

30629 

C 

0 

2 

3 

-0.84 

0.26 

0.25 

-0.27 

30629 

D 

0 

2 

3 

-0.16 

0.17 

0.48 

-0.17 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30630 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30630 

A 

1 

44 

79 

1.02 

0.15 

0.97 

0.39 

30630 

B 

0 

5 

9 

0.40 

0.47 

1.50 

-0.12 

30630 

C 

0 

4 

7 

-0.63 

0.56 

0.52 

-0.37 

30630 

D 

0 

3 

5 

0.21 

0.14 

0.75 

-0.13 

30631 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

30631 

A 

1 

47 

82 

0.97 

0.17 

1.24 

0.40 

30631 

B 

0 

3 

5 

0.02 

0.86 

1.45 

-0.14 

30631 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30631 

D 

0 

7 

12 

-0.50 

0.42 

0.63 

-0.37 

30632 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.06 

30632 

A 

1 

24 

43 

1.23 

0.33 

0.94 

0.47 

30632 

B 

0 

7 

13 

0.24 

0.20 

0.97 

-0.08 

30632 

C 

0 

10 

18 

-0.49 

0.24 

0.51 

-0.35 

30632 

D 

0 

15 

27 

0.13 

0.22 

1.12 

-0.17 

30633 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30633 

A 

1 

41 

73 

1.27 

0.22 

1.19 

0.47 

30633 

B 

0 

9 

16 

-0.38 

0.35 

0.92 

-0.38 

30633 

C 

0 

1 

2 

-0.27 

0.00 

0.49 

-0.11 

30633 

D 

0 

5 

9 

-0.04 

0.18 

0.65 

-0.19 

30634 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.02 

30634 

A 

1 

37 

67 

1.31 

0.20 

0.88 

0.44 

30634 

B 

0 

8 

15 

0.26 

0.30 

0.93 

-0.21 

30634 

C 

0 

6 

11 

0.35 

0.51 

1.57 

-0.16 

30634 

D 

0 

4 

7 

-0.47 

0.62 

0.52 

-0.31 

30635 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.03 

30635 

A 

1 

47 

85 

1.12 

0.20 

0.87 

0.46 

30635 

B 

0 

3 

5 

-0.75 

0.59 

0.48 

-0.27 

30635 

C 

0 

5 

9 

-0.67 

0.27 

0.45 

-0.34 

30635 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30636 

* 

-1 

4942 

99 

1.21 

0.02 

0.00 

0.02 

30636 

A 

1 

45 

87 

1.02 

0.20 

0.97 

0.26 

30636 

B 

0 

2 

4 

-0.16 

0.39 

0.64 

-0.15 

30636 

C 

0 

5 

10 

0.03 

0.67 

1.83 

-0.21 

30636 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30637 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.01 

30637 

A 

1 

42 

75 

1.38 

0.20 

0.98 

0.35 

30637 

B 

0 

10 

18 

0.24 

0.30 

0.97 

-0.32 

30637 

C 

0 

1 

2 

2.33 

0.00 

4.93 

0.13 

30637 

D 

0 

3 

5 

0.02 

0.22 

0.51 

-0.20 

30638 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

30638 

A 

1 

41 

72 

1.22 

0.18 

0.75 

0.55 

30638 

B 

0 

6 

11 

0.04 

0.16 

0.66 

-0.21 

30638 

C 

0 

7 

12 

-0.47 

0.24 

0.45 

-0.38 

30638 

D 

0 

3 

5 

-0.58 

0.85 

0.55 

-0.26 

30639 

* 

-1 

4925 

99 

1.21 

0.02 

0.00 

0.04 

30639 

A 

1 

52 

75 

1.11 

0.15 

0.88 

0.53 

30639 

B 

0 

1 

1 

0.17 

0.00 

0.75 

-0.06 

30639 

C 

0 

11 

16 

-0.08 

0.20 

0.69 

-0.29 

30639 

D 

0 

5 

7 

-1.17 

0.54 

0.30 

-0.44 

30640 

* 

-1 

4923 

99 

1.21 

0.02 

0.00 

0.04 

30640 

A 

1 

44 

62 

1.24 

0.17 

0.91 

0.49 

30640 

B 

0 

11 

15 

0.26 

0.30 

1.08 

-0.18 

30640 

C 

0 

10 

14 

0.30 

0.30 

1.11 

-0.16 

30640 

D 

0 

6 

8 

-0.85 

0.23 

0.27 

-0.41 

30641 

* 

-1 

4946 

99 

1.21 

0.02 

0.00 

0.05 

30641 

A 

1 

42 

88 

0.65 

0.16 

0.96 

0.25 

30641 

B 

0 

3 

6 

-0.23 

0.44 

0.79 

-0.19 

30641 

C 

0 

2 

4 

-0.27 

1.63 

1.67 

-0.16 

30641 

D 

0 

1 

2 

0.36 

0.00 

1.18 

-0.03 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30642 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

30642 

A 

1 

51 

89 

0.80 

0.16 

1.07 

0.19 

30642 

B 

0 

4 

7 

0.23 

0.66 

1.67 

-0.12 

30642 

C 

0 

1 

2 

0.20 

0.00 

0.94 

-0.06 

30642 

D 

0 

1 

2 

-0.51 

0.00 

0.46 

-0.15 

30643 

* 

-1 

4925 

99 

1.21 

0.02 

0.00 

0.03 

30643 

A 

1 

44 

64 

1.25 

0.17 

0.98 

0.45 

30643 

B 

0 

19 

28 

0.27 

0.20 

0.91 

-0.32 

30643 

C 

0 

1 

1 

1.03 

0.00 

1.42 

0.02 

30643 

D 

0 

5 

7 

-0.35 

0.39 

0.46 

-0.29 

30644 

* 

-1 

4946 

99 

1.21 

0.02 

0.00 

0.03 

30644 

A 

1 

30 

63 

1.19 

0.26 

1.14 

0.44 

30644 

B 

0 

7 

15 

0.08 

0.17 

0.71 

-0.21 

30644 

C 

0 

7 

15 

0.04 

0.34 

0.85 

-0.23 

30644 

D 

0 

4 

8 

-0.16 

0.22 

0.55 

-0.21 

30645 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.02 

30645 

A 

1 

35 

60 

1.31 

0.18 

0.91 

0.46 

30645 

B 

0 

11 

19 

0.67 

0.22 

1.13 

-0.10 

30645 

C 

0 

5 

9 

0.01 

0.44 

0.66 

-0.25 

30645 

D 

0 

7 

12 

-0.16 

0.28 

0.47 

-0.36 

30646 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.03 

30646 

A 

1 

45 

82 

1.10 

0.13 

0.84 

0.53 

30646 

B 

0 

3 

5 

-0.19 

0.55 

0.59 

-0.25 

30646 

C 

0 

5 

9 

-0.03 

0.32 

0.68 

-0.28 

30646 

D 

0 

2 

4 

-0.89 

0.78 

0.31 

-0.34 

30647 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.02 

30647 

A 

1 

28 

51 

1.37 

0.24 

1.99 

0.41 

30647 

B 

0 

7 

13 

0.30 

0.38 

0.83 

-0.20 

30647 

C 

0 

11 

20 

0.64 

0.26 

1.15 

-0.11 

30647 

D 

0 

9 

16 

0.22 

0.24 

0.68 

-0.26 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30648 

* 

-1 

4924 

99 

1.21 

0.02 

0.00 

0.05 

30648 

A 

1 

11 

16 

0.82 

0.27 

1.56 

0.06 

30648 

B 

0 

43 

61 

0.83 

0.14 

1.23 

0.19 

30648 

C 

0 

11 

16 

0.37 

0.33 

1.06 

-0.14 

30648 

D 

0 

5 

7 

-0.19 

0.61 

0.56 

-0.25 

30649 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30649 

A 

1 

35 

63 

1.15 

0.18 

1.11 

0.43 

30649 

B 

0 

9 

16 

0.04 

0.22 

0.67 

-0.30 

30649 

C 

0 

11 

20 

0.26 

0.33 

1.22 

-0.24 

30649 

D 

0 

1 

2 

0.43 

0.00 

0.80 

-0.04 

30650 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.06 

30650 

A 

1 

42 

75 

0.76 

0.14 

0.77 

0.56 

30650 

B 

0 

2 

4 

-0.62 

0.38 

0.49 

-0.18 

30650 

C 

0 

4 

7 

-1.09 

0.53 

0.38 

-0.38 

30650 

D 

0 

8 

14 

-0.46 

0.35 

0.73 

-0.32 

30651 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.03 

30651 

A 

1 

56 

95 

0.90 

0.15 

0.93 

0.33 

30651 

B 

0 

3 

5 

-0.83 

0.41 

0.38 

-0.33 

30651 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30651 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30652 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

30652 

A 

1 

33 

59 

0.96 

0.20 

1.34 

0.25 

30652 

B 

0 

3 

5 

-0.71 

0.34 

0.29 

-0.33 

30652 

C 

0 

18 

32 

0.66 

0.19 

1.32 

-0.06 

30652 

D 

0 

2 

4 

0.19 

0.57 

0.72 

-0.10 

30653 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.04 

30653 

A 

1 

25 

43 

0.97 

0.19 

1.15 

0.25 

30653 

B 

0 

20 

34 

0.68 

0.25 

1.53 

0.01 

30653 

C 

0 

11 

19 

0.25 

0.34 

1.16 

-0.18 

30653 

D 

0 

2 

3 

-1.03 

0.62 

0.20 

-0.30 

easyCBM  CCSS  Third  Grade  Math  Measure  Development 


335 

Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30654 

* 

-1 

4699 

94 

1.17 

0.02 

0.00 

-0.10 

30654 

A 

1 

236 

80 

1.99 

0.08 

1.01 

0.37 

30654 

B 

0 

22 

7 

0.54 

0.18 

0.64 

-0.26 

30654 

C 

0 

35 

12 

0.99 

0.20 

1.33 

-0.22 

30654 

D 

0 

2 

1 

0.12 

0.53 

0.34 

-0.10 

30655 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30655 

A 

1 

45 

80 

0.93 

0.16 

1.01 

0.28 

30655 

B 

0 

6 

11 

0.39 

0.19 

0.98 

-0.13 

30655 

C 

0 

4 

7 

0.30 

0.58 

1.24 

-0.13 

30655 

D 

0 

1 

2 

-1.53 

0.00 

0.13 

-0.29 

30656 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.05 

30656 

A 

1 

38 

70 

0.91 

0.16 

1.10 

0.44 

30656 

B 

0 

8 

15 

0.24 

0.53 

1.88 

-0.08 

30656 

C 

0 

1 

2 

0.41 

0.00 

1.01 

-0.01 

30656 

D 

0 

7 

13 

-1.37 

0.77 

0.47 

-0.51 

30657 

* 

-1 

4946 

99 

1.21 

0.02 

0.00 

0.04 

30657 

A 

1 

31 

65 

1.03 

0.17 

0.85 

0.55 

30657 

B 

0 

6 

13 

-0.50 

0.33 

0.51 

-0.40 

30657 

C 

0 

7 

15 

0.42 

0.19 

1.06 

-0.07 

30657 

D 

0 

4 

8 

-0.73 

0.41 

0.36 

-0.38 

30658 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.02 

30658 

A 

1 

34 

63 

1.25 

0.16 

0.95 

0.37 

30658 

B 

0 

8 

15 

0.23 

0.26 

0.67 

-0.31 

30658 

C 

0 

8 

15 

1.14 

0.40 

2.23 

0.07 

30658 

D 

0 

4 

7 

-0.30 

0.17 

0.33 

-0.36 

30659 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

30659 

A 

1 

32 

57 

1.04 

0.17 

1.01 

0.43 

30659 

B 

0 

6 

11 

0.27 

0.26 

0.84 

-0.13 

30659 

C 

0 

12 

21 

0.43 

0.17 

1.05 

-0.12 

30659 

D 

0 

6 

11 

-0.54 

0.52 

0.63 

-0.41 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30660 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

30660 

A 

1 

39 

70 

0.96 

0.12 

0.84 

0.45 

30660 

B 

0 

9 

16 

0.35 

0.39 

1.47 

-0.15 

30660 

C 

0 

4 

7 

-0.12 

0.53 

0.76 

-0.23 

30660 

D 

0 

4 

7 

-0.58 

0.27 

0.37 

-0.37 

30661 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.03 

30661 

A 

1 

48 

91 

1.03 

0.15 

0.76 

0.56 

30661 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30661 

C 

0 

1 

2 

-0.56 

0.00 

0.44 

-0.16 

30661 

D 

0 

4 

8 

-1.46 

0.31 

0.21 

-0.54 

30662 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

30662 

A 

1 

45 

80 

0.96 

0.15 

0.91 

0.51 

30662 

B 

0 

5 

9 

-0.72 

0.32 

0.42 

-0.40 

30662 

C 

0 

5 

9 

-0.33 

0.36 

0.63 

-0.29 

30662 

D 

0 

1 

2 

0.32 

0.00 

0.98 

-0.04 

30663 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.02 

30663 

A 

1 

46 

85 

1.31 

0.18 

0.78 

0.54 

30663 

B 

0 

2 

4 

-0.15 

0.10 

0.55 

-0.17 

30663 

C 

0 

3 

6 

-0.74 

0.53 

0.41 

-0.31 

30663 

D 

0 

3 

6 

-1.23 

0.36 

0.21 

-0.40 

30664 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.05 

30664 

A 

1 

33 

62 

1.07 

0.19 

0.87 

0.53 

30664 

B 

0 

3 

6 

-0.05 

0.57 

0.89 

-0.13 

30664 

C 

0 

13 

25 

-0.02 

0.26 

1.02 

-0.28 

30664 

D 

0 

4 

8 

-1.14 

0.43 

0.30 

-0.41 

30665 

* 

-1 

4942 

99 

1.21 

0.02 

0.00 

0.06 

30665 

A 

1 

11 

21 

1.10 

0.34 

1.28 

0.29 

30665 

B 

0 

16 

31 

0.77 

0.23 

1.37 

0.18 

30665 

C 

0 

8 

15 

-0.08 

0.32 

0.59 

-0.21 

30665 

D 

0 

17 

33 

0.03 

0.29 

0.85 

-0.27 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30666 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.06 

30666 

A 

1 

50 

89 

0.59 

0.17 

0.91 

0.38 

30666 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30666 

C 

0 

3 

5 

0.00 

0.48 

1.48 

-0.08 

30666 

D 

0 

3 

5 

-2.06 

0.61 

0.23 

-0.44 

30667 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.04 

30667 

A 

1 

46 

85 

0.90 

0.17 

0.88 

0.43 

30667 

B 

0 

1 

2 

-0.42 

0.00 

0.55 

-0.12 

30667 

C 

0 

3 

6 

-0.70 

0.86 

0.81 

-0.26 

30667 

D 

0 

4 

7 

-0.68 

0.61 

0.73 

-0.30 

30668 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.04 

30668 

A 

1 

38 

72 

0.96 

0.17 

1.05 

0.45 

30668 

B 

0 

13 

25 

-0.02 

0.19 

0.78 

-0.36 

30668 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30668 

D 

0 

2 

4 

-0.76 

0.89 

0.43 

-0.26 

30669 

* 

-1 

1962 

39 

1.87 

0.03 

0.00 

0.40 

30669 

A 

1 

2157 

71 

1.04 

0.02 

1.02 

0.37 

30669 

B 

0 

657 

22 

0.36 

0.04 

1.24 

-0.19 

30669 

C 

0 

74 

2 

-0.36 

0.10 

0.55 

-0.16 

30669 

D 

0 

144 

5 

-0.80 

0.11 

0.45 

-0.31 

30670 

* 

-1 

4936 

99 

1.22 

0.02 

0.00 

0.07 

30670 

A 

1 

37 

64 

0.81 

0.17 

1.02 

0.41 

30670 

B 

0 

16 

28 

0.12 

0.22 

1.14 

-0.12 

30670 

C 

0 

2 

3 

0.08 

0.05 

0.77 

-0.04 

30670 

D 

0 

3 

5 

-3.20 

1.32 

0.13 

-0.61 

30671 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.05 

30671 

A 

1 

26 

49 

0.99 

0.13 

0.78 

0.56 

30671 

B 

0 

7 

13 

0.12 

0.16 

0.71 

-0.21 

30671 

C 

0 

4 

8 

0.27 

0.41 

1.01 

-0.10 

30671 

D 

0 

16 

30 

0.05 

0.19 

0.78 

-0.40 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30672 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.05 

30672 

A 

1 

37 

65 

0.83 

0.17 

1.02 

0.32 

30672 

B 

0 

4 

7 

-0.08 

0.52 

0.88 

-0.16 

30672 

C 

0 

4 

7 

0.56 

0.35 

1.35 

0.00 

30672 

D 

0 

12 

21 

0.01 

0.38 

1.50 

-0.27 

30673 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

30673 

A 

1 

47 

82 

0.99 

0.12 

0.87 

0.50 

30673 

B 

0 

2 

4 

0.22 

0.14 

0.75 

-0.11 

30673 

C 

0 

1 

2 

1.01 

0.00 

1.64 

0.03 

30673 

D 

0 

7 

12 

-0.55 

0.17 

0.38 

-0.53 

30674 

* 

-1 

4688 

94 

1.17 

0.02 

0.00 

-0.10 

30674 

A 

1 

299 

98 

1.78 

0.07 

0.95 

0.20 

30674 

B 

0 

3 

1 

0.17 

1.14 

1.41 

-0.12 

30674 

C 

0 

1 

0 

1.26 

0.00 

1.26 

-0.02 

30674 

D 

0 

3 

1 

-0.60 

0.37 

0.23 

-0.18 

30675 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.04 

30675 

A 

1 

45 

83 

0.97 

0.17 

0.88 

0.44 

30675 

B 

0 

1 

2 

0.34 

0.00 

0.99 

-0.05 

30675 

C 

0 

2 

4 

-0.62 

0.82 

0.52 

-0.23 

30675 

D 

0 

6 

11 

-0.49 

0.37 

0.62 

-0.37 

30676 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.05 

30676 

A 

1 

44 

79 

1.04 

0.17 

0.80 

0.56 

30676 

B 

0 

3 

5 

-1.82 

1.33 

0.41 

-0.41 

30676 

C 

0 

1 

2 

0.62 

0.00 

1.46 

0.00 

30676 

D 

0 

8 

14 

-0.77 

0.32 

0.48 

-0.40 

30677 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.04 

30677 

A 

1 

14 

25 

1.28 

0.17 

0.80 

0.35 

30677 

B 

0 

3 

5 

-0.40 

0.64 

0.37 

-0.28 

30677 

C 

0 

14 

25 

0.60 

0.25 

0.99 

-0.07 

30677 

D 

0 

24 

44 

0.58 

0.19 

1.12 

-0.12 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30678 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.02 

30678 

A 

1 

28 

50 

1.37 

0.21 

1.01 

0.37 

30678 

B 

0 

4 

7 

0.93 

0.51 

1.43 

0.00 

30678 

C 

0 

13 

23 

0.77 

0.35 

1.47 

-0.09 

30678 

D 

0 

11 

20 

0.08 

0.18 

0.50 

-0.37 

30679 

* 

-1 

4930 

99 

1.21 

0.02 

0.00 

0.04 

30679 

A 

1 

22 

34 

1.53 

0.21 

0.83 

0.51 

30679 

B 

0 

12 

19 

0.60 

0.30 

1.37 

-0.05 

30679 

C 

0 

8 

13 

0.54 

0.35 

0.98 

-0.06 

30679 

D 

0 

22 

34 

0.03 

0.22 

0.75 

-0.43 

30680 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

30680 

A 

1 

17 

30 

1.07 

0.19 

1.10 

0.21 

30680 

B 

0 

12 

21 

1.28 

0.45 

4.83 

0.25 

30680 

C 

0 

11 

20 

0.83 

0.32 

1.72 

0.07 

30680 

D 

0 

16 

29 

-0.37 

0.29 

0.51 

-0.51 

30681 

* 

-1 

4928 

99 

1.21 

0.02 

0.00 

0.02 

30681 

A 

1 

10 

15 

2.08 

0.32 

0.86 

0.39 

30681 

B 

0 

17 

26 

1.39 

0.21 

1.40 

0.20 

30681 

C 

0 

29 

44 

0.64 

0.20 

0.81 

-0.25 

30681 

D 

0 

10 

15 

0.15 

0.45 

0.50 

-0.29 

30682 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.05 

30682 

A 

1 

29 

51 

1.06 

0.18 

0.95 

0.45 

30682 

B 

0 

7 

12 

0.01 

0.46 

0.91 

-0.21 

30682 

C 

0 

15 

26 

0.25 

0.19 

0.92 

-0.20 

30682 

D 

0 

6 

11 

-0.04 

0.43 

0.79 

-0.21 

30683 

* 

-1 

4697 

94 

1.16 

0.02 

0.00 

-0.14 

30683 

A 

1 

232 

78 

2.34 

0.08 

0.84 

0.56 

30683 

B 

0 

23 

8 

0.63 

0.18 

0.55 

-0.28 

30683 

C 

0 

31 

10 

0.67 

0.16 

0.60 

-0.32 

30683 

D 

0 

11 

4 

-0.12 

0.34 

0.29 

-0.30 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30684 

* 

-1 

4931 

99 

1.21 

0.02 

0.00 

0.02 

30684 

A 

1 

41 

65 

1.22 

0.14 

1.00 

0.39 

30684 

B 

0 

6 

10 

0.48 

0.42 

1.01 

-0.16 

30684 

C 

0 

10 

16 

0.45 

0.30 

0.93 

-0.22 

30684 

D 

0 

6 

10 

0.37 

0.47 

1.10 

-0.19 

30685 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.02 

30685 

A 

1 

32 

55 

1.56 

0.17 

0.75 

0.64 

30685 

B 

0 

1 

2 

-0.23 

0.00 

0.34 

-0.13 

30685 

C 

0 

18 

31 

0.14 

0.19 

0.65 

-0.44 

30685 

D 

0 

7 

12 

-0.02 

0.35 

0.57 

-0.30 

30686 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.02 

30686 

A 

1 

35 

60 

1.29 

0.20 

1.14 

0.38 

30686 

B 

0 

7 

12 

0.84 

0.27 

1.32 

-0.03 

30686 

C 

0 

5 

9 

0.28 

0.30 

0.73 

-0.17 

30686 

D 

0 

11 

19 

0.16 

0.29 

0.80 

-0.32 

30687 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.05 

30687 

A 

1 

4 

7 

1.26 

0.61 

1.27 

0.18 

30687 

B 

0 

41 

75 

0.71 

0.15 

1.16 

0.16 

30687 

C 

0 

1 

2 

1.71 

0.00 

1.94 

0.15 

30687 

D 

0 

9 

16 

-0.21 

0.18 

0.32 

-0.37 

30688 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.03 

30688 

A 

1 

10 

17 

1.00 

0.43 

2.20 

0.09 

30688 

B 

0 

16 

27 

0.94 

0.22 

1.19 

0.09 

30688 

C 

0 

24 

41 

0.59 

0.20 

0.97 

-0.16 

30688 

D 

0 

9 

15 

0.86 

0.35 

1.39 

0.03 

30689 

* 

-1 

4932 

99 

1.21 

0.02 

0.00 

0.03 

30689 

A 

1 

13 

21 

1.85 

0.41 

1.41 

0.41 

30689 

B 

0 

11 

18 

0.97 

0.32 

1.17 

0.05 

30689 

C 

0 

25 

40 

0.69 

0.20 

0.87 

-0.10 

30689 

D 

0 

13 

21 

0.00 

0.30 

0.52 

-0.34 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30690 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.03 

30690 

A 

1 

7 

13 

2.04 

0.69 

0.94 

0.41 

30690 

B 

0 

39 

74 

0.67 

0.15 

1.03 

-0.23 

30690 

C 

0 

2 

4 

0.61 

0.10 

0.65 

-0.04 

30690 

D 

0 

5 

9 

0.43 

0.31 

0.65 

-0.11 

30691 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.05 

30691 

A 

1 

2 

4 

-0.94 

0.55 

10.40 

-0.22 

30691 

B 

0 

30 

54 

0.86 

0.19 

1.08 

0.21 

30691 

C 

0 

9 

16 

0.65 

0.47 

1.33 

0.02 

30691 

D 

0 

15 

27 

0.25 

0.46 

0.97 

-0.16 

30692 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30692 

A 

1 

11 

20 

1.48 

0.46 

2.07 

0.27 

30692 

B 

0 

11 

20 

1.07 

0.27 

1.30 

0.10 

30692 

C 

0 

10 

18 

0.78 

0.28 

0.88 

-0.03 

30692 

D 

0 

24 

43 

0.49 

0.22 

0.82 

-0.28 

30693 

* 

-1 

4932 

99 

1.21 

0.02 

0.00 

0.03 

30693 

A 

1 

8 

13 

1.97 

0.20 

0.55 

0.41 

30693 

B 

0 

10 

16 

1.38 

0.34 

1.95 

0.21 

30693 

C 

0 

11 

18 

1.14 

0.28 

1.33 

0.11 

30693 

D 

0 

33 

53 

0.41 

0.14 

0.58 

-0.52 

30694 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.03 

30694 

A 

1 

13 

22 

1.28 

0.22 

1.10 

0.23 

30694 

B 

0 

22 

38 

0.90 

0.22 

1.32 

0.01 

30694 

C 

0 

3 

5 

1.15 

0.65 

1.47 

0.07 

30694 

D 

0 

20 

34 

0.59 

0.16 

0.81 

-0.24 

30695 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

30695 

A 

1 

7 

13 

0.82 

0.29 

1.51 

0.03 

30695 

B 

0 

3 

5 

1.20 

0.38 

1.39 

0.12 

30695 

C 

0 

15 

27 

1.02 

0.22 

1.51 

0.19 

30695 

D 

0 

31 

55 

0.55 

0.16 

0.96 

-0.25 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30696 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.02 

30696 

A 

1 

10 

19 

1.84 

0.52 

1.19 

0.38 

30696 

B 

0 

6 

11 

0.99 

0.34 

1.12 

0.00 

30696 

C 

0 

13 

24 

1.15 

0.27 

1.52 

0.08 

30696 

D 

0 

25 

46 

0.56 

0.14 

0.71 

-0.37 

30697 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.02 

30697 

A 

1 

18 

32 

1.98 

0.32 

0.75 

0.57 

30697 

B 

0 

10 

18 

0.96 

0.22 

1.24 

-0.01 

30697 

C 

0 

7 

12 

0.13 

0.32 

0.54 

-0.27 

30697 

D 

0 

22 

39 

0.47 

0.15 

0.75 

-0.35 

30698 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.05 

30698 

A 

1 

31 

57 

0.83 

0.21 

1.35 

0.31 

30698 

B 

0 

6 

11 

0.31 

0.24 

1.01 

-0.08 

30698 

C 

0 

8 

15 

-0.09 

0.44 

0.87 

-0.25 

30698 

D 

0 

9 

17 

0.27 

0.23 

1.03 

-0.11 

30699 

* 

-1 

4932 

99 

1.21 

0.02 

0.00 

0.05 

30699 

A 

1 

40 

65 

1.03 

0.16 

0.86 

0.49 

30699 

B 

0 

10 

16 

-0.07 

0.23 

0.76 

-0.27 

30699 

C 

0 

4 

6 

-0.49 

0.55 

0.57 

-0.26 

30699 

D 

0 

8 

13 

-0.01 

0.41 

0.90 

-0.21 

30700 

* 

-1 

4944 

99 

1.21 

0.02 

0.00 

0.02 

30700 

A 

1 

33 

66 

1.39 

0.15 

0.78 

0.62 

30700 

B 

0 

5 

10 

0.32 

0.38 

0.83 

-0.19 

30700 

C 

0 

3 

6 

0.28 

0.57 

0.80 

-0.16 

30700 

D 

0 

9 

18 

-0.22 

0.22 

0.43 

-0.51 

30701 

* 

-1 

4946 

99 

1.21 

0.02 

0.00 

0.03 

30701 

A 

-1 

48 

100 

0.82 

0.15 

0.00 

0.00 

30701 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30701 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30701 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30702 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.02 

30702 

A 

1 

52 

90 

1.06 

0.17 

1.01 

0.21 

30702 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30702 

C 

0 

5 

9 

0.40 

0.38 

1.15 

-0.15 

30702 

D 

0 

1 

2 

-0.49 

0.00 

0.35 

-0.17 

30703 

* 

-1 

4947 

99 

1.21 

0.02 

0.00 

0.03 

30703 

A 

-1 

47 

100 

0.80 

0.12 

0.00 

0.00 

30703 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30703 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30703 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30704 

* 

-1 

4954 

99 

1.21 

0.02 

0.00 

0.01 

30704 

A 

1 

30 

75 

1.11 

0.21 

1.10 

0.16 

30704 

B 

0 

2 

5 

0.21 

0.08 

0.59 

-0.16 

30704 

C 

0 

1 

3 

0.55 

0.00 

0.83 

-0.07 

30704 

D 

0 

7 

18 

0.87 

0.51 

1.94 

-0.06 

30705 

* 

-1 

4955 

99 

1.21 

0.02 

0.00 

0.02 

30705 

A 

1 

38 

97 

0.97 

0.14 

0.98 

0.25 

30705 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30705 

C 

0 

1 

3 

-0.38 

0.00 

0.37 

-0.25 

30705 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30706 

* 

-1 

4951 

99 

1.21 

0.02 

0.00 

0.03 

30706 

A 

1 

42 

98 

0.86 

0.14 

0.93 

0.34 

30706 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30706 

C 

0 

1 

2 

-1.32 

0.00 

0.19 

-0.34 

30706 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30707 

* 

-1 

4963 

99 

1.21 

0.02 

0.00 

0.04 

30707 

A 

1 

26 

84 

0.63 

0.21 

1.14 

0.12 

30707 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30707 

C 

0 

5 

16 

0.30 

0.39 

1.41 

-0.12 

30707 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30708 

* 

-1 

4954 

99 

1.21 

0.02 

0.00 

0.03 

30708 

A 

1 

38 

95 

0.80 

0.16 

1.01 

0.15 

30708 

B 

0 

1 

3 

-0.56 

0.00 

0.38 

-0.22 

30708 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30708 

D 

0 

1 

3 

0.80 

0.00 

1.48 

0.01 

30709 

* 

-1 

4947 

99 

1.21 

0.02 

0.00 

0.05 

30709 

A 

1 

41 

87 

0.57 

0.14 

1.06 

0.09 

30709 

B 

0 

3 

6 

0.14 

1.14 

1.96 

-0.11 

30709 

C 

0 

2 

4 

0.22 

0.30 

1.05 

-0.07 

30709 

D 

0 

1 

2 

1.00 

0.00 

2.19 

0.07 

30710 

* 

-1 

4946 

99 

1.21 

0.02 

0.00 

0.04 

30710 

A 

1 

42 

88 

0.71 

0.17 

1.13 

-0.01 

30710 

B 

0 

2 

4 

0.94 

0.47 

1.94 

0.04 

30710 

C 

0 

4 

8 

0.64 

0.43 

1.71 

-0.02 

30710 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30711 

* 

-1 

4944 

99 

1.21 

0.02 

0.00 

0.02 

30711 

A 

1 

46 

92 

0.97 

0.15 

1.04 

0.12 

30711 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30711 

C 

0 

4 

8 

0.54 

0.22 

0.96 

-0.12 

30711 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30712 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.03 

30712 

A 

1 

43 

80 

1.14 

0.17 

0.76 

0.47 

30712 

B 

0 

1 

2 

-1.17 

0.00 

0.21 

-0.19 

30712 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30712 

D 

0 

10 

19 

-0.43 

0.61 

1.48 

-0.42 

30713 

* 

-1 

4942 

99 

1.21 

0.02 

0.00 

0.03 

30713 

A 

1 

43 

83 

0.98 

0.17 

1.10 

0.21 

30713 

B 

0 

2 

4 

0.32 

0.99 

1.25 

-0.10 

30713 

C 

0 

1 

2 

0.69 

0.00 

1.18 

-0.02 

30713 

D 

0 

6 

12 

0.36 

0.47 

1.39 

-0.17 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30714 

* 

-1 

4950 

99 

1.21 

0.02 

0.00 

0.02 

30714 

A 

1 

41 

93 

1.02 

0.20 

0.92 

0.32 

30714 

B 

0 

3 

7 

-0.65 

0.49 

0.48 

-0.32 

30714 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30714 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30715 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.02 

30715 

A 

1 

59 

98 

0.93 

0.14 

1.02 

0.09 

30715 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30715 

C 

0 

1 

2 

0.14 

0.00 

0.73 

-0.09 

30715 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30716 

* 

-1 

4957 

99 

1.21 

0.02 

0.00 

0.04 

30716 

A 

1 

34 

92 

0.69 

0.18 

0.98 

0.32 

30716 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30716 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30716 

D 

0 

3 

8 

-0.52 

0.28 

0.53 

-0.32 

30717 

* 

-1 

4957 

99 

1.21 

0.02 

0.00 

0.03 

30717 

A 

1 

35 

95 

0.80 

0.20 

1.04 

0.16 

30717 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30717 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30717 

D 

0 

2 

5 

0.02 

0.13 

0.76 

-0.16 

30718 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.02 

30718 

A 

1 

52 

98 

0.98 

0.17 

1.00 

0.13 

30718 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30718 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30718 

D 

0 

1 

2 

-0.17 

0.00 

0.54 

-0.13 

30719 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.04 

30719 

A 

1 

42 

78 

0.91 

0.13 

0.92 

0.40 

30719 

B 

0 

6 

11 

0.68 

0.29 

1.58 

-0.01 

30719 

C 

0 

2 

4 

-0.05 

1.01 

0.93 

-0.15 

30719 

D 

0 

4 

7 

-1.11 

0.11 

0.21 

-0.52 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30720 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.04 

30720 

A 

1 

43 

80 

0.79 

0.17 

1.03 

0.29 

30720 

B 

0 

5 

9 

0.39 

0.48 

1.72 

-0.07 

30720 

C 

0 

1 

2 

-0.01 

0.00 

0.71 

-0.08 

30720 

D 

0 

5 

9 

-0.38 

0.31 

0.60 

-0.30 

30721 

* 

-1 

4945 

99 

1.21 

0.02 

0.00 

0.05 

30721 

A 

1 

37 

76 

0.80 

0.17 

1.15 

0.34 

30721 

B 

0 

4 

8 

0.36 

0.61 

1.58 

-0.07 

30721 

C 

0 

4 

8 

-0.37 

0.36 

0.58 

-0.27 

30721 

D 

0 

4 

8 

-0.06 

0.61 

1.00 

-0.19 

30722 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.02 

30722 

A 

1 

53 

93 

1.06 

0.15 

0.84 

0.45 

30722 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30722 

C 

0 

1 

2 

-1.17 

0.00 

0.21 

-0.24 

30722 

D 

0 

3 

5 

-0.94 

0.50 

0.34 

-0.37 

30723 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

30723 

A 

1 

52 

93 

0.79 

0.17 

1.06 

0.16 

30723 

B 

0 

1 

2 

-0.62 

0.00 

0.44 

-0.15 

30723 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30723 

D 

0 

3 

5 

0.26 

0.52 

1.40 

-0.09 

30724 

* 

-1 

4956 

99 

1.21 

0.02 

0.00 

0.01 

30724 

A 

1 

36 

95 

1.10 

0.19 

0.94 

0.34 

30724 

B 

0 

1 

3 

-0.95 

0.00 

0.24 

-0.27 

30724 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30724 

D 

0 

1 

3 

-0.49 

0.00 

0.39 

-0.21 

30725 

* 

-1 

4951 

99 

1.21 

0.02 

0.00 

0.02 

30725 

A 

1 

38 

88 

1.07 

0.21 

0.96 

0.27 

30725 

B 

0 

2 

5 

-0.37 

0.44 

0.48 

-0.23 

30725 

C 

0 

2 

5 

-0.31 

0.59 

0.54 

-0.22 

30725 

D 

0 

1 

2 

1.37 

0.00 

2.50 

0.05 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30726 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

30726 

A 

1 

38 

67 

1.12 

0.14 

1.01 

0.36 

30726 

B 

0 

8 

14 

0.93 

0.46 

2.00 

0.03 

30726 

C 

0 

2 

4 

0.09 

0.29 

0.55 

-0.14 

30726 

D 

0 

9 

16 

-0.13 

0.32 

0.64 

-0.41 

30727 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.01 

30727 

A 

1 

51 

89 

1.20 

0.17 

0.99 

0.33 

30727 

B 

0 

3 

5 

0.18 

0.40 

0.83 

-0.17 

30727 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30727 

D 

0 

3 

5 

-0.41 

0.73 

0.68 

-0.28 

30728 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.03 

30728 

A 

1 

43 

81 

1.10 

0.17 

0.86 

0.51 

30728 

B 

0 

1 

2 

-0.78 

0.00 

0.31 

-0.18 

30728 

C 

0 

1 

2 

-1.02 

0.00 

0.24 

-0.20 

30728 

D 

0 

8 

15 

-0.41 

0.30 

0.58 

-0.41 

30729 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

30729 

A 

1 

50 

88 

0.85 

0.15 

1.17 

0.23 

30729 

B 

0 

6 

11 

0.09 

0.11 

0.75 

-0.22 

30729 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30729 

D 

0 

1 

2 

0.27 

0.00 

0.87 

-0.06 

30730 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.05 

30730 

A 

1 

50 

94 

0.58 

0.17 

0.98 

0.24 

30730 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30730 

C 

0 

2 

4 

-0.96 

0.72 

0.49 

-0.24 

30730 

D 

0 

1 

2 

-0.04 

0.00 

0.97 

-0.06 

30731 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

30731 

A 

1 

39 

68 

1.17 

0.21 

0.97 

0.38 

30731 

B 

0 

4 

7 

-0.18 

0.43 

0.66 

-0.22 

30731 

C 

0 

12 

21 

0.19 

0.32 

1.22 

-0.26 

30731 

D 

0 

2 

4 

0.32 

1.13 

1.38 

-0.08 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30732 

* 

-1 

4943 

99 

1.21 

0.02 

0.00 

0.04 

30732 

A 

1 

47 

92 

0.89 

0.15 

0.77 

0.51 

30732 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30732 

C 

0 

1 

2 

-0.98 

0.00 

0.33 

-0.19 

30732 

D 

0 

3 

6 

-1.63 

1.29 

0.43 

-0.47 

30733 

* 

-1 

4945 

99 

1.21 

0.02 

0.00 

0.03 

30733 

A 

1 

32 

65 

1.22 

0.22 

0.97 

0.49 

30733 

B 

0 

14 

29 

0.06 

0.17 

0.73 

-0.38 

30733 

C 

0 

2 

4 

0.02 

0.33 

0.61 

-0.13 

30733 

D 

0 

1 

2 

-1.44 

0.00 

0.13 

-0.27 

30734 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.05 

30734 

A 

1 

48 

89 

0.73 

0.17 

0.99 

0.29 

30734 

B 

0 

3 

6 

-0.69 

0.73 

0.72 

-0.26 

30734 

C 

0 

2 

4 

-0.47 

0.34 

0.58 

-0.18 

30734 

D 

0 

1 

2 

0.66 

0.00 

1.72 

0.01 

30735 

* 

-1 

4955 

99 

1.21 

0.02 

0.00 

0.03 

30735 

A 

1 

26 

67 

0.79 

0.19 

1.44 

-0.05 

30735 

B 

0 

7 

18 

1.03 

0.29 

1.77 

0.11 

30735 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30735 

D 

0 

6 

15 

0.71 

0.35 

1.31 

-0.05 

30736 

* 

-1 

4956 

99 

1.21 

0.02 

0.00 

0.02 

30736 

A 

1 

20 

53 

1.62 

0.24 

1.11 

0.40 

30736 

B 

0 

3 

8 

1.24 

0.40 

1.16 

0.05 

30736 

C 

0 

6 

16 

0.74 

0.34 

0.80 

-0.05 

30736 

D 

0 

9 

24 

-0.57 

1.00 

0.80 

-0.46 

30737 

* 

-1 

4953 

99 

1.21 

0.02 

0.00 

0.01 

30737 

A 

1 

17 

41 

1.52 

0.28 

1.28 

0.33 

30737 

B 

0 

8 

20 

1.14 

0.24 

1.20 

0.01 

30737 

C 

0 

5 

12 

1.44 

0.47 

1.95 

0.11 

30737 

D 

0 

11 

27 

0.31 

0.24 

0.60 

-0.46 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30738 

* 

-1 

4947 

99 

1.21 

0.02 

0.00 

0.02 

30738 

A 

1 

32 

68 

1.03 

0.14 

1.14 

0.24 

30738 

B 

0 

2 

4 

1.25 

0.53 

1.77 

0.09 

30738 

C 

0 

3 

6 

0.27 

0.51 

0.74 

-0.21 

30738 

D 

0 

10 

21 

0.61 

0.25 

1.06 

-0.19 

30739 

* 

-1 

4944 

99 

1.21 

0.02 

0.00 

0.04 

30739 

A 

1 

47 

94 

0.87 

0.12 

0.63 

0.65 

30739 

B 

0 

1 

2 

-1.11 

0.00 

0.31 

-0.22 

30739 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30739 

D 

0 

2 

4 

-2.88 

1.58 

0.13 

-0.63 

30740 

* 

-1 

4961 

99 

1.21 

0.02 

0.00 

0.02 

30740 

A 

-1 

33 

100 

0.91 

0.18 

0.00 

0.00 

30740 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30740 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30740 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30741 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.05 

30741 

A 

1 

44 

79 

0.63 

0.15 

1.16 

0.22 

30741 

B 

0 

2 

4 

-0.20 

0.62 

0.74 

-0.14 

30741 

C 

0 

2 

4 

-0.05 

0.37 

0.76 

-0.11 

30741 

D 

0 

8 

14 

0.22 

0.36 

1.41 

-0.13 

30742 

* 

-1 

4954 

99 

1.21 

0.02 

0.00 

0.02 

30742 

A 

1 

35 

88 

0.99 

0.22 

1.20 

0.14 

30742 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30742 

C 

0 

1 

3 

1.73 

0.00 

3.43 

0.10 

30742 

D 

0 

4 

10 

0.18 

0.32 

0.87 

-0.20 

30743 

* 

-1 

4944 

99 

1.21 

0.02 

0.00 

0.04 

30743 

A 

1 

34 

68 

0.77 

0.16 

1.19 

0.13 

30743 

B 

0 

11 

22 

0.80 

0.19 

1.58 

0.07 

30743 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30743 

D 

0 

5 

10 

-0.15 

0.44 

0.69 

-0.31 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30744 

* 

-1 

4947 

99 

1.21 

0.02 

0.00 

0.04 

30744 

A 

1 

42 

89 

0.75 

0.14 

1.04 

0.19 

30744 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30744 

C 

0 

4 

9 

0.35 

0.35 

1.11 

-0.13 

30744 

D 

0 

1 

2 

-0.23 

0.00 

0.51 

-0.16 

30745 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.05 

30745 

A 

1 

45 

85 

0.73 

0.14 

0.99 

0.32 

30745 

B 

0 

1 

2 

0.14 

0.00 

0.82 

-0.07 

30745 

C 

0 

3 

6 

0.08 

0.49 

0.99 

-0.14 

30745 

D 

0 

4 

8 

-0.27 

0.31 

0.64 

-0.27 

30746 

* 

-1 

4945 

99 

1.21 

0.02 

0.00 

0.02 

30746 

A 

1 

47 

96 

0.95 

0.13 

0.99 

0.26 

30746 

B 

0 

2 

4 

-0.22 

0.63 

0.56 

-0.26 

30746 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30746 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30747 

* 

-1 

4942 

99 

1.21 

0.02 

0.00 

0.03 

30747 

A 

1 

33 

63 

1.25 

0.19 

0.94 

0.45 

30747 

B 

0 

3 

6 

0.34 

0.80 

1.29 

-0.11 

30747 

C 

0 

7 

13 

0.24 

0.43 

1.02 

-0.21 

30747 

D 

0 

9 

17 

0.08 

0.23 

0.65 

-0.31 

30748 

* 

-1 

4943 

99 

1.21 

0.02 

0.00 

0.03 

30748 

A 

1 

41 

80 

0.83 

0.13 

1.12 

0.08 

30748 

B 

0 

3 

6 

0.98 

0.67 

2.04 

0.06 

30748 

C 

0 

6 

12 

0.56 

0.26 

1.13 

-0.11 

30748 

D 

0 

1 

2 

0.35 

0.00 

0.76 

-0.08 

30749 

* 

-1 

4947 

99 

1.21 

0.02 

0.00 

0.05 

30749 

A 

1 

38 

81 

0.69 

0.16 

1.07 

0.25 

30749 

B 

0 

8 

17 

0.04 

0.19 

0.84 

-0.26 

30749 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30749 

D 

0 

1 

2 

0.57 

0.00 

1.27 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30750 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.05 

30750 

A 

1 

51 

88 

0.71 

0.15 

1.00 

0.38 

30750 

B 

0 

2 

3 

-0.38 

0.79 

0.81 

-0.15 

30750 

C 

0 

3 

5 

-0.55 

0.34 

0.57 

-0.23 

30750 

D 

0 

2 

3 

-0.91 

0.73 

0.46 

-0.24 

30751 

* 

-1 

4708 

94 

1.18 

0.02 

0.00 

-0.07 

30751 

A 

1 

173 

60 

2.17 

0.08 

0.89 

0.53 

30751 

B 

0 

35 

12 

0.68 

0.20 

0.87 

-0.26 

30751 

C 

0 

70 

24 

1.00 

0.10 

0.82 

-0.25 

30751 

D 

0 

8 

3 

-1.40 

0.86 

0.20 

-0.38 

30752 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

30752 

A 

1 

54 

95 

0.70 

0.12 

1.05 

0.01 

30752 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30752 

C 

0 

2 

4 

1.40 

0.64 

3.50 

0.15 

30752 

D 

0 

1 

2 

-0.79 

0.00 

0.32 

-0.22 

30753 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.05 

30753 

A 

1 

49 

86 

0.76 

0.14 

1.06 

0.29 

30753 

B 

0 

2 

4 

0.50 

1.05 

1.93 

-0.03 

30753 

C 

0 

3 

5 

-0.22 

0.27 

0.62 

-0.20 

30753 

D 

0 

3 

5 

-0.30 

0.53 

0.67 

-0.22 

30754 

* 

-1 

4950 

99 

1.21 

0.02 

0.00 

0.02 

30754 

A 

1 

38 

86 

1.15 

0.13 

0.87 

0.51 

30754 

B 

0 

1 

2 

-0.34 

0.00 

0.36 

-0.22 

30754 

C 

0 

1 

2 

0.07 

0.00 

0.54 

-0.15 

30754 

D 

0 

4 

9 

-0.25 

0.43 

0.50 

-0.42 

30755 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.03 

30755 

A 

1 

25 

43 

1.12 

0.22 

1.39 

0.24 

30755 

B 

0 

28 

48 

0.80 

0.15 

1.13 

-0.06 

30755 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30755 

D 

0 

5 

9 

-0.11 

0.36 

0.46 

-0.31 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30756 

* 

-1 

4952 

99 

1.21 

0.02 

0.00 

0.05 

30756 

A 

1 

39 

93 

0.60 

0.18 

0.78 

0.44 

30756 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30756 

C 

0 

1 

2 

-0.51 

0.00 

0.75 

-0.12 

30756 

D 

0 

2 

5 

-2.15 

2.04 

0.57 

-0.45 

30757 

* 

-1 

4954 

99 

1.21 

0.02 

0.00 

0.03 

30757 

A 

1 

28 

70 

1.17 

0.15 

0.78 

0.59 

30757 

B 

0 

2 

5 

0.10 

0.12 

0.61 

-0.15 

30757 

C 

0 

6 

15 

0.14 

0.38 

0.91 

-0.25 

30757 

D 

0 

4 

10 

-0.78 

0.58 

0.40 

-0.49 

30758 

* 

-1 

4952 

99 

1.21 

0.02 

0.00 

0.03 

30758 

A 

1 

32 

76 

1.03 

0.17 

0.93 

0.40 

30758 

B 

0 

8 

19 

0.12 

0.48 

1.17 

-0.29 

30758 

C 

0 

1 

2 

-1.25 

0.00 

0.17 

-0.29 

30758 

D 

0 

1 

2 

0.18 

0.00 

0.70 

-0.09 

30759 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.04 

30759 

A 

1 

21 

35 

1.39 

0.20 

0.91 

0.47 

30759 

B 

0 

12 

20 

0.55 

0.37 

1.35 

-0.07 

30759 

C 

0 

8 

13 

0.60 

0.30 

1.11 

-0.03 

30759 

D 

0 

19 

32 

0.04 

0.21 

0.59 

-0.40 

30760 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.05 

30760 

A 

1 

49 

92 

0.81 

0.19 

0.79 

0.49 

30760 

B 

0 

3 

6 

-1.75 

0.25 

0.21 

-0.40 

30760 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30760 

D 

0 

1 

2 

-2.19 

0.00 

0.13 

-0.27 

30761 

* 

-1 

4942 

99 

1.21 

0.02 

0.00 

0.02 

30761 

A 

1 

50 

96 

1.05 

0.19 

0.97 

0.25 

30761 

B 

0 

1 

2 

-1.04 

0.00 

0.24 

-0.21 

30761 

C 

0 

1 

2 

-0.32 

0.00 

0.50 

-0.14 

30761 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30762 

* 

-1 

4932 

99 

1.21 

0.02 

0.00 

0.03 

30762 

A 

1 

53 

85 

1.10 

0.16 

0.88 

0.46 

30762 

B 

0 

1 

2 

-0.80 

0.00 

0.30 

-0.17 

30762 

C 

0 

4 

6 

-0.57 

0.37 

0.47 

-0.30 

30762 

D 

0 

4 

6 

-0.42 

0.42 

0.60 

-0.27 

30763 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.04 

30763 

A 

1 

46 

78 

0.79 

0.17 

1.22 

0.15 

30763 

B 

0 

9 

15 

0.50 

0.44 

1.91 

-0.07 

30763 

C 

0 

1 

2 

1.29 

0.00 

2.45 

0.07 

30763 

D 

0 

3 

5 

-0.31 

0.36 

0.55 

-0.20 

30764 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.05 

30764 

A 

1 

44 

81 

0.72 

0.18 

1.17 

0.30 

30764 

B 

0 

8 

15 

-0.13 

0.44 

1.18 

-0.23 

30764 

C 

0 

1 

2 

-0.35 

0.00 

0.60 

-0.10 

30764 

D 

0 

1 

2 

-0.97 

0.00 

0.32 

-0.17 

30765 

* 

-1 

4695 

94 

1.17 

0.02 

0.00 

-0.10 

30765 

A 

1 

267 

89 

1.87 

0.08 

1.13 

0.25 

30765 

B 

0 

9 

3 

0.55 

0.27 

0.75 

-0.16 

30765 

C 

0 

17 

6 

1.12 

0.25 

1.51 

-0.12 

30765 

D 

0 

6 

2 

0.10 

0.39 

0.55 

-0.18 

30766 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.02 

30766 

A 

1 

41 

75 

1.11 

0.16 

0.92 

0.35 

30766 

B 

0 

8 

15 

0.71 

0.35 

1.55 

-0.07 

30766 

C 

0 

1 

2 

-0.78 

0.00 

0.24 

-0.22 

30766 

D 

0 

5 

9 

-0.22 

0.19 

0.46 

-0.33 

30767 

* 

-1 

4942 

99 

1.21 

0.02 

0.00 

0.04 

30767 

A 

1 

46 

88 

0.91 

0.18 

0.84 

0.43 

30767 

B 

0 

5 

10 

-0.71 

0.50 

0.62 

-0.35 

30767 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30767 

D 

0 

1 

2 

-1.69 

0.00 

0.16 

-0.25 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30768 

* 

-1 

4932 

99 

1.21 

0.02 

0.00 

0.05 

30768 

A 

1 

22 

35 

1.25 

0.26 

1.51 

0.41 

30768 

B 

0 

27 

44 

0.57 

0.15 

1.07 

-0.06 

30768 

C 

0 

5 

8 

-0.31 

0.35 

0.44 

-0.26 

30768 

D 

0 

8 

13 

-0.20 

0.33 

0.58 

-0.30 

30769 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.04 

30769 

A 

1 

23 

43 

1.33 

0.23 

0.98 

0.50 

30769 

B 

0 

6 

11 

0.37 

0.21 

0.75 

-0.13 

30769 

C 

0 

10 

19 

0.50 

0.33 

1.01 

-0.11 

30769 

D 

0 

15 

28 

0.13 

0.13 

0.59 

-0.37 

30770 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.04 

30770 

A 

1 

25 

45 

0.91 

0.21 

1.35 

0.21 

30770 

B 

0 

15 

27 

0.78 

0.28 

1.53 

0.06 

30770 

C 

0 

5 

9 

0.52 

0.21 

0.89 

-0.05 

30770 

D 

0 

10 

18 

0.00 

0.28 

0.64 

-0.31 

30771 

* 

-1 

1943 

39 

1.88 

0.03 

0.00 

0.40 

30771 

A 

1 

530 

17 

1.28 

0.06 

1.60 

0.20 

30771 

B 

0 

546 

18 

0.79 

0.05 

1.29 

0.01 

30771 

C 

0 

713 

23 

0.89 

0.04 

1.39 

0.05 

30771 

D 

0 

1262 

41 

0.49 

0.03 

0.94 

-0.21 

30772 

* 

-1 

4943 

99 

1.21 

0.02 

0.00 

0.04 

30772 

A 

1 

19 

37 

1.32 

0.21 

0.82 

0.46 

30772 

B 

0 

8 

16 

0.63 

0.29 

1.10 

-0.04 

30772 

C 

0 

10 

20 

0.29 

0.28 

0.78 

-0.22 

30772 

D 

0 

14 

27 

0.29 

0.27 

1.03 

-0.27 

30773 

* 

-1 

4929 

99 

1.21 

0.02 

0.00 

0.03 

30773 

A 

1 

29 

45 

1.46 

0.21 

1.00 

0.44 

30773 

B 

0 

10 

15 

0.94 

0.25 

1.29 

0.02 

30773 

C 

0 

10 

15 

0.44 

0.33 

0.88 

-0.16 

30773 

D 

0 

16 

25 

0.10 

0.27 

0.68 

-0.38 

easyCBM  CCSS  Third  Grade  Math  Measure  Development 


355 

Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30774 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.05 

30774 

A 

1 

14 

24 

1.24 

0.25 

1.06 

0.32 

30774 

B 

0 

5 

9 

0.89 

0.36 

1.30 

0.08 

30774 

C 

0 

7 

12 

0.32 

0.31 

0.78 

-0.10 

30774 

D 

0 

32 

55 

0.38 

0.21 

0.93 

-0.25 

30775 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30775 

A 

1 

14 

25 

1.12 

0.27 

1.47 

0.17 

30775 

B 

0 

5 

9 

0.39 

0.42 

0.74 

-0.13 

30775 

C 

0 

8 

14 

1.38 

0.19 

1.59 

0.23 

30775 

D 

0 

29 

52 

0.58 

0.21 

1.45 

-0.24 

30776 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.03 

30776 

A 

1 

14 

26 

1.22 

0.37 

1.82 

0.23 

30776 

B 

0 

8 

15 

0.51 

0.46 

0.99 

-0.10 

30776 

C 

0 

9 

17 

1.06 

0.33 

1.47 

0.12 

30776 

D 

0 

23 

43 

0.47 

0.19 

0.89 

-0.23 

30777 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.03 

30777 

A 

1 

12 

22 

1.73 

0.52 

1.28 

0.35 

30777 

B 

0 

6 

11 

1.06 

0.42 

1.47 

0.06 

30777 

C 

0 

7 

13 

0.30 

0.59 

1.25 

-0.14 

30777 

D 

0 

29 

54 

0.50 

0.20 

0.95 

-0.24 

30778 

* 

-1 

4930 

99 

1.21 

0.02 

0.00 

0.03 

30778 

A 

1 

27 

42 

1.22 

0.17 

1.06 

0.38 

30778 

B 

0 

10 

16 

0.36 

0.13 

0.64 

-0.22 

30778 

C 

0 

11 

17 

0.69 

0.21 

1.04 

-0.07 

30778 

D 

0 

16 

25 

0.54 

0.25 

1.10 

-0.18 

30779 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.05 

30779 

A 

1 

10 

18 

1.12 

0.62 

4.12 

0.19 

30779 

B 

0 

11 

19 

0.59 

0.28 

0.95 

0.00 

30779 

C 

0 

7 

12 

0.79 

0.56 

1.72 

0.05 

30779 

D 

0 

29 

51 

0.37 

0.21 

0.76 

-0.18 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30780 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.01 

30780 

A 

1 

4 

7 

2.59 

1.29 

1.19 

0.35 

30780 

B 

0 

19 

34 

0.75 

0.20 

0.74 

-0.19 

30780 

C 

0 

17 

30 

1.46 

0.17 

1.34 

0.21 

30780 

D 

0 

16 

29 

0.66 

0.31 

1.12 

-0.22 

30781 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30781 

A 

1 

19 

34 

1.40 

0.33 

1.04 

0.31 

30781 

B 

0 

6 

11 

0.86 

0.40 

1.49 

0.01 

30781 

C 

0 

4 

7 

0.18 

0.51 

0.74 

-0.13 

30781 

D 

0 

27 

48 

0.47 

0.27 

1.25 

-0.24 

30782 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.02 

30782 

A 

1 

10 

18 

1.71 

0.71 

2.44 

0.25 

30782 

B 

0 

7 

12 

1.00 

0.66 

2.08 

0.02 

30782 

C 

0 

16 

28 

1.24 

0.25 

1.46 

0.14 

30782 

D 

0 

24 

42 

0.36 

0.20 

0.63 

-0.33 

30783 

* 

-1 

4947 

99 

1.21 

0.02 

0.00 

0.05 

30783 

A 

1 

16 

34 

1.34 

0.46 

1.46 

0.37 

30783 

B 

0 

6 

13 

0.99 

0.46 

2.17 

0.11 

30783 

C 

0 

10 

21 

0.23 

0.24 

0.82 

-0.12 

30783 

D 

0 

15 

32 

-0.19 

0.32 

0.62 

-0.35 

30784 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.04 

30784 

A 

1 

27 

50 

1.31 

0.18 

0.76 

0.54 

30784 

B 

0 

5 

9 

0.27 

0.38 

0.88 

-0.14 

30784 

C 

0 

4 

7 

0.31 

0.27 

0.74 

-0.11 

30784 

D 

0 

18 

33 

0.10 

0.23 

0.81 

-0.43 

30785 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.02 

30785 

A 

1 

30 

54 

1.47 

0.19 

0.78 

0.50 

30785 

B 

0 

7 

13 

0.51 

0.34 

0.97 

-0.12 

30785 

C 

0 

11 

20 

0.57 

0.19 

0.90 

-0.13 

30785 

D 

0 

8 

14 

-0.49 

0.56 

0.46 

-0.45 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30786 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.02 

30786 

A 

1 

40 

74 

1.27 

0.18 

1.03 

0.45 

30786 

B 

0 

2 

4 

0.73 

0.54 

1.18 

-0.04 

30786 

C 

0 

5 

9 

0.17 

0.10 

0.60 

-0.23 

30786 

D 

0 

7 

13 

-0.11 

0.24 

0.53 

-0.37 

30787 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.03 

30787 

A 

1 

15 

27 

1.65 

0.35 

1.11 

0.44 

30787 

B 

0 

19 

35 

0.47 

0.18 

0.72 

-0.27 

30787 

C 

0 

6 

11 

1.23 

0.17 

1.25 

0.11 

30787 

D 

0 

15 

27 

0.47 

0.24 

0.79 

-0.23 

30788 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

30788 

A 

1 

34 

60 

1.16 

0.25 

1.21 

0.34 

30788 

B 

0 

9 

16 

0.64 

0.27 

1.34 

-0.03 

30788 

C 

0 

6 

11 

0.53 

0.43 

1.31 

-0.05 

30788 

D 

0 

8 

14 

-0.68 

0.60 

0.57 

-0.40 

30789 

* 

-1 

4933 

99 

1.21 

0.02 

0.00 

0.02 

30789 

A 

1 

37 

61 

1.43 

0.19 

0.94 

0.49 

30789 

B 

0 

11 

18 

0.53 

0.28 

1.02 

-0.17 

30789 

C 

0 

6 

10 

0.52 

0.30 

0.90 

-0.12 

30789 

D 

0 

7 

11 

-0.43 

0.25 

0.34 

-0.43 

30790 

* 

-1 

4924 

99 

1.22 

0.02 

0.00 

0.07 

30790 

A 

1 

17 

24 

1.01 

0.24 

1.12 

0.33 

30790 

B 

0 

43 

61 

0.36 

0.13 

1.10 

-0.07 

30790 

C 

0 

2 

3 

1.17 

0.31 

1.80 

0.13 

30790 

D 

0 

8 

11 

-0.70 

0.30 

0.34 

-0.40 

30791 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.02 

30791 

A 

1 

16 

29 

1.73 

0.43 

1.25 

0.41 

30791 

B 

0 

8 

14 

0.93 

0.23 

1.10 

0.01 

30791 

C 

0 

25 

45 

0.65 

0.18 

1.00 

-0.17 

30791 

D 

0 

7 

13 

-0.17 

0.25 

0.38 

-0.32 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30792 

* 

-1 

4924 

99 

1.21 

0.02 

0.00 

0.03 

30792 

A 

1 

20 

29 

1.77 

0.21 

0.76 

0.50 

30792 

B 

0 

3 

4 

0.64 

0.29 

0.67 

-0.06 

30792 

C 

0 

40 

57 

0.69 

0.13 

0.95 

-0.24 

30792 

D 

0 

7 

10 

-0.09 

0.54 

0.51 

-0.31 

30793 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30793 

A 

1 

22 

39 

1.71 

0.29 

0.73 

0.56 

30793 

B 

0 

15 

27 

0.09 

0.25 

0.91 

-0.31 

30793 

C 

0 

13 

23 

0.48 

0.22 

0.97 

-0.12 

30793 

D 

0 

6 

11 

-0.28 

0.47 

0.56 

-0.27 

30794 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.05 

30794 

A 

1 

11 

19 

1.27 

0.30 

1.07 

0.31 

30794 

B 

0 

6 

10 

0.25 

0.10 

0.52 

-0.13 

30794 

C 

0 

38 

64 

0.58 

0.17 

1.11 

-0.08 

30794 

D 

0 

4 

7 

0.05 

0.28 

0.47 

-0.16 

30795 

* 

-1 

4928 

99 

1.21 

0.02 

0.00 

0.06 

30795 

A 

1 

46 

70 

0.89 

0.16 

0.89 

0.47 

30795 

B 

0 

10 

15 

0.15 

0.20 

1.03 

-0.15 

30795 

C 

0 

5 

8 

-0.09 

0.19 

0.71 

-0.16 

30795 

D 

0 

5 

8 

-1.20 

0.31 

0.25 

-0.45 

30796 

* 

-1 

4821 

97 

1.20 

0.02 

0.00 

-0.01 

30796 

A 

1 

101 

58 

1.60 

0.11 

1.13 

0.32 

30796 

B 

0 

42 

24 

0.78 

0.17 

1.19 

-0.21 

30796 

C 

0 

29 

17 

0.93 

0.23 

2.17 

-0.12 

30796 

D 

0 

1 

1 

-4.19 

0.00 

0.00 

-0.33 

30797 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.02 

30797 

A 

1 

27 

51 

1.30 

0.21 

1.06 

0.40 

30797 

B 

0 

8 

15 

0.39 

0.29 

0.84 

-0.19 

30797 

C 

0 

4 

8 

0.68 

0.22 

0.89 

-0.06 

30797 

D 

0 

14 

26 

0.42 

0.29 

1.10 

-0.26 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30798 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.04 

30798 

A 

1 

24 

44 

1.43 

0.21 

0.89 

0.52 

30798 

B 

0 

17 

31 

0.24 

0.23 

0.83 

-0.27 

30798 

C 

0 

5 

9 

-0.11 

0.78 

1.47 

-0.22 

30798 

D 

0 

9 

16 

0.24 

0.30 

0.80 

-0.18 

30799 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

30799 

A 

1 

43 

75 

1.01 

0.15 

0.82 

0.51 

30799 

B 

0 

10 

18 

-0.12 

0.41 

1.18 

-0.31 

30799 

C 

0 

2 

4 

-0.74 

0.88 

0.46 

-0.23 

30799 

D 

0 

2 

4 

-1.36 

0.36 

0.19 

-0.33 

30800 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

30800 

A 

1 

29 

52 

1.23 

0.15 

0.79 

0.54 

30800 

B 

0 

6 

11 

0.52 

0.27 

0.97 

-0.09 

30800 

C 

0 

10 

18 

0.19 

0.20 

0.68 

-0.28 

30800 

D 

0 

11 

20 

0.13 

0.29 

0.81 

-0.33 

30801 

* 

-1 

4933 

99 

1.21 

0.02 

0.00 

0.03 

30801 

A 

1 

49 

80 

1.05 

0.18 

1.00 

0.41 

30801 

B 

0 

2 

3 

0.71 

1.51 

3.35 

-0.01 

30801 

C 

0 

3 

5 

-0.43 

0.44 

0.53 

-0.22 

30801 

D 

0 

7 

11 

-0.48 

0.23 

0.50 

-0.36 

30802 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.02 

30802 

A 

1 

36 

62 

1.36 

0.16 

1.03 

0.46 

30802 

B 

0 

6 

10 

0.73 

0.31 

1.07 

-0.10 

30802 

C 

0 

2 

3 

0.83 

0.18 

0.93 

-0.04 

30802 

D 

0 

14 

24 

0.29 

0.18 

0.68 

-0.43 

30803 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.01 

30803 

A 

1 

36 

67 

1.47 

0.13 

0.82 

0.55 

30803 

B 

0 

3 

6 

-0.35 

0.47 

0.32 

-0.38 

30803 

C 

0 

9 

17 

0.37 

0.20 

0.63 

-0.35 

30803 

D 

0 

6 

11 

0.74 

0.33 

1.00 

-0.14 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30804 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30804 

A 

1 

32 

57 

1.35 

0.15 

0.73 

0.64 

30804 

B 

0 

3 

5 

-0.36 

0.38 

0.40 

-0.26 

30804 

C 

0 

6 

11 

0.64 

0.23 

1.09 

-0.04 

30804 

D 

0 

15 

27 

-0.18 

0.20 

0.55 

-0.55 

30805 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30805 

A 

1 

42 

75 

1.24 

0.14 

0.75 

0.61 

30805 

B 

0 

3 

5 

-0.88 

0.78 

0.36 

-0.37 

30805 

C 

0 

1 

2 

-0.36 

0.00 

0.39 

-0.15 

30805 

D 

0 

10 

18 

-0.16 

0.29 

0.85 

-0.42 

30806 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.02 

30806 

A 

1 

36 

63 

1.27 

0.15 

0.89 

0.49 

30806 

B 

0 

6 

11 

0.38 

0.26 

0.76 

-0.19 

30806 

C 

0 

3 

5 

0.51 

0.21 

0.79 

-0.10 

30806 

D 

0 

12 

21 

0.18 

0.29 

0.87 

-0.39 

30807 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.02 

30807 

A 

1 

43 

72 

1.17 

0.14 

0.99 

0.38 

30807 

B 

0 

8 

13 

0.29 

0.34 

0.88 

-0.25 

30807 

C 

0 

3 

5 

0.56 

0.22 

0.85 

-0.08 

30807 

D 

0 

6 

10 

0.24 

0.63 

1.15 

-0.23 

30808 

* 

-1 

4946 

99 

1.21 

0.02 

0.00 

0.03 

30808 

A 

1 

34 

71 

1.16 

0.18 

0.87 

0.57 

30808 

B 

0 

3 

6 

0.33 

0.10 

0.85 

-0.09 

30808 

C 

0 

3 

6 

-0.87 

0.76 

0.38 

-0.36 

30808 

D 

0 

8 

17 

-0.30 

0.13 

0.48 

-0.40 

30809 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.05 

30809 

A 

1 

38 

67 

0.90 

0.16 

0.87 

0.44 

30809 

B 

0 

4 

7 

0.26 

0.46 

1.23 

-0.07 

30809 

C 

0 

3 

5 

0.18 

0.22 

0.86 

-0.08 

30809 

D 

0 

12 

21 

-0.40 

0.38 

0.97 

-0.43 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30810 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.02 

30810 

A 

1 

38 

68 

1.39 

0.16 

0.77 

0.55 

30810 

B 

0 

5 

9 

0.54 

0.62 

1.93 

-0.09 

30810 

C 

0 

4 

7 

-0.63 

0.25 

0.28 

-0.33 

30810 

D 

0 

9 

16 

-0.30 

0.52 

0.60 

-0.40 

30811 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.01 

30811 

A 

1 

56 

98 

1.08 

0.15 

1.02 

0.09 

30811 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30811 

C 

0 

1 

2 

0.29 

0.00 

0.79 

-0.09 

30811 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30812 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

30812 

A 

1 

50 

88 

0.85 

0.14 

0.82 

0.44 

30812 

B 

0 

5 

9 

-0.48 

0.54 

0.79 

-0.29 

30812 

C 

0 

1 

2 

1.13 

0.00 

2.47 

0.05 

30812 

D 

0 

1 

2 

-4.18 

0.00 

0.01 

-0.54 

30813 

* 

-1 

4709 

94 

1.17 

0.02 

0.00 

-0.12 

30813 

A 

1 

280 

98 

1.90 

0.08 

0.83 

0.24 

30813 

B 

0 

1 

0 

0.40 

0.00 

0.60 

-0.06 

30813 

C 

0 

3 

1 

0.03 

0.90 

0.75 

-0.13 

30813 

D 

0 

1 

0 

-4.18 

0.00 

0.01 

-0.25 

30814 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30814 

A 

1 

48 

86 

0.87 

0.18 

1.23 

0.15 

30814 

B 

0 

1 

2 

-1.56 

0.00 

0.16 

-0.26 

30814 

C 

0 

6 

11 

0.89 

0.38 

2.66 

0.03 

30814 

D 

0 

1 

2 

-1.04 

0.00 

0.26 

-0.20 

30815 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30815 

A 

1 

54 

96 

0.89 

0.16 

0.98 

0.20 

30815 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30815 

C 

0 

2 

4 

-0.39 

0.50 

0.53 

-0.20 

30815 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30816 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

30816 

A 

1 

50 

89 

0.79 

0.14 

0.93 

0.34 

30816 

B 

0 

2 

4 

0.05 

0.76 

0.98 

-0.12 

30816 

C 

0 

1 

2 

-0.19 

0.00 

0.60 

-0.12 

30816 

D 

0 

3 

5 

-0.58 

0.59 

0.56 

-0.30 

30817 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.05 

30817 

A 

1 

53 

96 

0.82 

0.13 

0.50 

0.77 

30817 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30817 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30817 

D 

0 

2 

4 

-5.09 

0.80 

0.02 

-0.77 

30818 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.04 

30818 

A 

1 

55 

95 

0.72 

0.14 

1.05 

0.27 

30818 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30818 

C 

0 

2 

3 

-0.62 

0.11 

0.45 

-0.23 

30818 

D 

0 

1 

2 

-0.40 

0.00 

0.56 

-0.13 

30819 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.01 

30819 

A 

1 

56 

98 

1.03 

0.15 

1.03 

0.06 

30819 

B 

0 

1 

2 

0.56 

0.00 

1.10 

-0.06 

30819 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30819 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30820 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.02 

30820 

A 

1 

55 

98 

0.91 

0.13 

1.03 

0.01 

30820 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30820 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30820 

D 

0 

1 

2 

0.83 

0.00 

1.42 

-0.01 

30821 

* 

-1 

4717 

94 

1.18 

0.02 

0.00 

-0.07 

30821 

A 

1 

157 

57 

2.23 

0.11 

0.99 

0.48 

30821 

B 

0 

86 

31 

0.94 

0.11 

1.04 

-0.31 

30821 

C 

0 

25 

9 

0.96 

0.18 

0.90 

-0.14 

30821 

D 

0 

9 

3 

-0.81 

0.74 

0.39 

-0.30 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30822 

* 

-1 

4944 

99 

1.21 

0.02 

0.00 

0.03 

30822 

A 

1 

10 

20 

1.30 

0.57 

1.76 

0.17 

30822 

B 

0 

30 

60 

0.89 

0.17 

1.36 

0.04 

30822 

C 

0 

4 

8 

1.20 

0.41 

1.51 

0.08 

30822 

D 

0 

6 

12 

-0.37 

0.81 

0.56 

-0.34 

30823 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.04 

30823 

A 

1 

27 

46 

0.99 

0.20 

1.27 

0.22 

30823 

B 

0 

9 

15 

1.00 

0.44 

2.45 

0.11 

30823 

C 

0 

11 

19 

0.74 

0.24 

1.32 

0.01 

30823 

D 

0 

12 

20 

-0.11 

0.31 

0.63 

-0.38 

30824 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.05 

30824 

A 

1 

11 

19 

0.56 

0.27 

1.80 

0.01 

30824 

B 

0 

24 

42 

0.38 

0.19 

0.98 

-0.16 

30824 

C 

0 

15 

26 

0.93 

0.21 

1.53 

0.25 

30824 

D 

0 

7 

12 

0.28 

0.38 

0.89 

-0.11 

30825 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.02 

30825 

A 

1 

37 

66 

1.16 

0.16 

1.03 

0.27 

30825 

B 

0 

7 

13 

0.96 

0.33 

1.50 

-0.01 

30825 

C 

0 

7 

13 

0.34 

0.27 

0.73 

-0.26 

30825 

D 

0 

5 

9 

0.53 

0.20 

0.79 

-0.15 

30826 

* 

-1 

4933 

99 

1.21 

0.02 

0.00 

0.05 

30826 

A 

1 

10 

16 

1.35 

0.25 

0.78 

0.37 

30826 

B 

0 

7 

11 

0.40 

0.26 

0.77 

-0.09 

30826 

C 

0 

34 

56 

0.50 

0.15 

0.99 

-0.16 

30826 

D 

0 

10 

16 

0.46 

0.26 

0.90 

-0.08 

30827 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.02 

30827 

A 

1 

6 

11 

0.96 

0.24 

1.45 

0.01 

30827 

B 

0 

28 

49 

0.96 

0.18 

1.21 

0.03 

30827 

C 

0 

5 

9 

1.70 

0.34 

2.01 

0.28 

30827 

D 

0 

18 

32 

0.67 

0.16 

0.73 

-0.21 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30828 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

30828 

A 

1 

14 

25 

1.13 

0.26 

1.29 

0.22 

30828 

B 

0 

25 

44 

0.55 

0.22 

1.25 

-0.16 

30828 

C 

0 

9 

16 

0.75 

0.33 

1.14 

0.01 

30828 

D 

0 

9 

16 

0.63 

0.27 

0.98 

-0.05 

30829 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

30829 

A 

1 

15 

26 

1.43 

0.23 

1.00 

0.37 

30829 

B 

0 

10 

18 

0.80 

0.32 

1.21 

-0.03 

30829 

C 

0 

27 

47 

0.52 

0.16 

0.82 

-0.34 

30829 

D 

0 

5 

9 

1.05 

0.38 

1.28 

0.06 

30830 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.02 

30830 

A 

1 

30 

54 

1.31 

0.13 

0.86 

0.42 

30830 

B 

0 

7 

13 

0.02 

0.37 

0.55 

-0.40 

30830 

C 

0 

9 

16 

1.26 

0.30 

1.95 

0.14 

30830 

D 

0 

10 

18 

0.30 

0.19 

0.61 

-0.34 

30831 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.04 

30831 

A 

1 

51 

88 

0.78 

0.13 

0.97 

0.28 

30831 

B 

0 

2 

3 

0.55 

0.35 

1.27 

-0.03 

30831 

C 

0 

3 

5 

-0.56 

0.74 

0.63 

-0.31 

30831 

D 

0 

2 

3 

0.17 

0.78 

1.07 

-0.10 

30832 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.02 

30832 

A 

1 

41 

72 

1.40 

0.16 

0.79 

0.57 

30832 

B 

0 

9 

16 

0.13 

0.24 

0.65 

-0.34 

30832 

C 

0 

4 

7 

-0.19 

0.48 

0.51 

-0.29 

30832 

D 

0 

3 

5 

-0.24 

0.43 

0.44 

-0.26 

30833 

* 

-1 

4933 

99 

1.21 

0.02 

0.00 

0.03 

30833 

A 

1 

50 

82 

0.93 

0.15 

1.08 

0.25 

30833 

B 

0 

4 

7 

0.80 

0.43 

1.76 

0.00 

30833 

C 

0 

3 

5 

0.52 

0.44 

1.20 

-0.06 

30833 

D 

0 

4 

7 

-0.48 

0.25 

0.40 

-0.33 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30834 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.02 

30834 

A 

1 

46 

87 

1.13 

0.14 

0.89 

0.43 

30834 

B 

0 

2 

4 

-0.21 

1.41 

0.98 

-0.22 

30834 

C 

0 

3 

6 

-0.11 

0.70 

0.83 

-0.25 

30834 

D 

0 

2 

4 

-0.25 

0.19 

0.44 

-0.23 

30835 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.02 

30835 

A 

1 

51 

86 

1.18 

0.11 

0.77 

0.59 

30835 

B 

0 

4 

7 

-0.66 

0.37 

0.33 

-0.47 

30835 

C 

0 

1 

2 

-0.01 

0.00 

0.51 

-0.14 

30835 

D 

0 

3 

5 

-0.29 

0.63 

0.58 

-0.31 

30836 

* 

-1 

4934 

99 

1.22 

0.02 

0.00 

0.06 

30836 

A 

1 

50 

83 

0.55 

0.10 

0.92 

0.30 

30836 

B 

0 

3 

5 

0.21 

0.78 

1.75 

-0.06 

30836 

C 

0 

5 

8 

-0.06 

0.53 

1.07 

-0.17 

30836 

D 

0 

2 

3 

-0.89 

0.94 

0.49 

-0.29 

30837 

* 

-1 

4933 

99 

1.21 

0.02 

0.00 

0.04 

30837 

A 

1 

47 

77 

0.92 

0.14 

0.88 

0.39 

30837 

B 

0 

4 

7 

-0.63 

0.87 

1.06 

-0.32 

30837 

C 

0 

7 

11 

0.37 

0.36 

1.36 

-0.10 

30837 

D 

0 

3 

5 

-0.45 

0.55 

0.57 

-0.24 

30838 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

30838 

A 

1 

40 

70 

0.96 

0.13 

0.90 

0.43 

30838 

B 

0 

9 

16 

0.39 

0.36 

1.31 

-0.13 

30838 

C 

0 

2 

4 

0.60 

0.14 

1.09 

-0.02 

30838 

D 

0 

6 

11 

-0.69 

0.28 

0.37 

-0.48 

30839 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.04 

30839 

A 

1 

6 

10 

1.63 

0.38 

0.77 

0.31 

30839 

B 

0 

48 

80 

0.72 

0.13 

1.01 

-0.03 

30839 

C 

0 

3 

5 

0.10 

0.50 

0.46 

-0.15 

30839 

D 

0 

3 

5 

-0.13 

0.86 

0.49 

-0.21 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30840 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.03 

30840 

A 

1 

48 

83 

1.00 

0.14 

0.98 

0.39 

30840 

B 

0 

3 

5 

0.32 

0.79 

1.52 

-0.11 

30840 

C 

0 

4 

7 

-0.29 

0.37 

0.55 

-0.30 

30840 

D 

0 

3 

5 

-0.14 

0.53 

0.69 

-0.22 

30841 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

30841 

A 

1 

39 

68 

0.97 

0.13 

0.96 

0.48 

30841 

B 

0 

5 

9 

0.19 

0.21 

0.76 

-0.17 

30841 

C 

0 

4 

7 

-0.34 

0.33 

0.47 

-0.32 

30841 

D 

0 

9 

16 

0.18 

0.25 

0.94 

-0.25 

30842 

* 

-1 

4946 

99 

1.21 

0.02 

0.00 

0.02 

30842 

A 

1 

39 

81 

1.23 

0.19 

0.90 

0.39 

30842 

B 

0 

1 

2 

0.54 

0.00 

0.92 

-0.05 

30842 

C 

0 

3 

6 

-0.43 

0.78 

0.53 

-0.30 

30842 

D 

0 

5 

10 

0.13 

0.40 

0.84 

-0.24 

30843 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.01 

30843 

A 

1 

26 

46 

1.75 

0.24 

0.81 

0.52 

30843 

B 

0 

18 

32 

0.69 

0.21 

0.98 

-0.21 

30843 

C 

0 

3 

5 

-0.59 

0.27 

0.22 

-0.32 

30843 

D 

0 

9 

16 

0.37 

0.33 

0.94 

-0.24 

30844 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.04 

30844 

A 

1 

42 

70 

0.99 

0.15 

1.09 

0.32 

30844 

B 

0 

4 

7 

0.38 

0.40 

0.95 

-0.10 

30844 

C 

0 

5 

8 

0.37 

0.20 

0.86 

-0.12 

30844 

D 

0 

9 

15 

0.18 

0.45 

1.34 

-0.25 

30845 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.02 

30845 

A 

1 

28 

47 

1.40 

0.19 

1.00 

0.40 

30845 

B 

0 

15 

25 

0.59 

0.27 

1.09 

-0.23 

30845 

C 

0 

8 

14 

0.84 

0.30 

1.21 

-0.06 

30845 

D 

0 

8 

14 

0.40 

0.12 

0.59 

-0.24 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30846 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.04 

30846 

A 

1 

21 

36 

1.68 

0.29 

0.80 

0.59 

30846 

B 

0 

15 

25 

0.34 

0.20 

0.84 

-0.19 

30846 

C 

0 

7 

12 

0.06 

0.28 

0.63 

-0.21 

30846 

D 

0 

16 

27 

0.15 

0.16 

0.64 

-0.30 

30847 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.04 

30847 

A 

1 

33 

55 

1.37 

0.15 

0.77 

0.65 

30847 

B 

0 

5 

8 

0.15 

0.29 

0.68 

-0.17 

30847 

C 

0 

6 

10 

-0.16 

0.20 

0.47 

-0.28 

30847 

D 

0 

16 

27 

-0.03 

0.24 

0.74 

-0.43 

30848 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

30848 

A 

1 

21 

37 

1.40 

0.28 

0.94 

0.41 

30848 

B 

0 

8 

14 

0.51 

0.35 

1.07 

-0.12 

30848 

C 

0 

13 

23 

0.38 

0.18 

0.83 

-0.23 

30848 

D 

0 

15 

26 

0.57 

0.20 

1.08 

-0.14 

30849 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.02 

30849 

A 

1 

36 

64 

1.29 

0.21 

1.04 

0.43 

30849 

B 

0 

4 

7 

0.53 

0.26 

0.94 

-0.09 

30849 

C 

0 

7 

13 

0.04 

0.29 

0.67 

-0.28 

30849 

D 

0 

9 

16 

0.24 

0.24 

0.80 

-0.25 

30850 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.02 

30850 

A 

1 

40 

70 

1.14 

0.13 

0.97 

0.31 

30850 

B 

0 

3 

5 

0.13 

0.68 

0.78 

-0.21 

30850 

C 

0 

4 

7 

0.36 

0.45 

0.87 

-0.17 

30850 

D 

0 

10 

18 

0.69 

0.37 

1.49 

-0.13 

30851 

* 

-1 

4960 

99 

1.21 

0.02 

0.00 

0.02 

30851 

A 

1 

28 

82 

1.13 

0.21 

0.90 

0.48 

30851 

B 

0 

4 

12 

-0.22 

0.20 

0.50 

-0.35 

30851 

C 

0 

2 

6 

-0.52 

0.18 

0.36 

-0.30 

30851 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30852 

* 

-1 

4954 

99 

1.21 

0.02 

0.00 

0.04 

30852 

A 

1 

34 

85 

0.75 

0.18 

0.95 

0.37 

30852 

B 

0 

4 

10 

0.01 

0.41 

1.03 

-0.18 

30852 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30852 

D 

0 

2 

5 

-1.04 

0.40 

0.30 

-0.35 

30853 

* 

-1 

4950 

99 

1.21 

0.02 

0.00 

0.05 

30853 

A 

1 

14 

32 

0.74 

0.23 

1.18 

0.19 

30853 

B 

0 

6 

14 

0.13 

0.41 

0.88 

-0.19 

30853 

C 

0 

12 

27 

0.74 

0.17 

1.31 

0.17 

30853 

D 

0 

12 

27 

0.21 

0.24 

0.92 

-0.23 

30854 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.05 

30854 

A 

1 

49 

83 

0.77 

0.13 

0.98 

0.35 

30854 

B 

0 

3 

5 

0.71 

0.33 

1.60 

0.02 

30854 

C 

0 

4 

7 

-0.18 

0.33 

0.69 

-0.23 

30854 

D 

0 

3 

5 

-0.81 

0.27 

0.34 

-0.36 

30855 

* 

-1 

4944 

99 

1.21 

0.02 

0.00 

0.03 

30855 

A 

1 

28 

56 

1.47 

0.25 

0.76 

0.55 

30855 

B 

0 

2 

4 

0.41 

0.65 

0.98 

-0.06 

30855 

C 

0 

10 

20 

0.16 

0.25 

0.79 

-0.23 

30855 

D 

0 

10 

20 

-0.35 

0.37 

0.67 

-0.42 

30856 

* 

-1 

4947 

99 

1.21 

0.02 

0.00 

0.01 

30856 

A 

1 

33 

70 

1.13 

0.15 

1.10 

0.18 

30856 

B 

0 

6 

13 

0.56 

0.35 

1.01 

-0.21 

30856 

C 

0 

3 

6 

0.44 

0.36 

0.73 

-0.18 

30856 

D 

0 

5 

11 

1.31 

0.43 

2.10 

0.11 

30857 

* 

-1 

4933 

99 

1.20 

0.02 

0.00 

-0.01 

30857 

A 

1 

25 

41 

1.90 

0.28 

1.67 

0.33 

30857 

B 

0 

26 

43 

1.11 

0.17 

1.03 

-0.18 

30857 

C 

0 

6 

10 

1.12 

0.69 

3.50 

-0.07 

30857 

D 

0 

4 

7 

0.32 

0.75 

0.88 

-0.22 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30858 

* 

-1 

4946 

99 

1.21 

0.02 

0.00 

0.03 

30858 

A 

1 

17 

35 

1.39 

0.38 

1.47 

0.33 

30858 

B 

0 

22 

46 

0.30 

0.22 

0.86 

-0.39 

30858 

C 

0 

6 

13 

1.39 

0.21 

1.84 

0.17 

30858 

D 

0 

3 

6 

0.48 

0.34 

0.75 

-0.07 

30859 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.04 

30859 

A 

1 

14 

24 

1.01 

0.29 

1.54 

0.18 

30859 

B 

0 

38 

64 

0.65 

0.14 

1.08 

-0.06 

30859 

C 

0 

4 

7 

0.38 

0.70 

1.11 

-0.09 

30859 

D 

0 

3 

5 

0.14 

0.75 

0.74 

-0.13 

30860 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.04 

30860 

A 

1 

35 

58 

0.78 

0.16 

1.40 

0.04 

30860 

B 

0 

2 

3 

1.00 

0.30 

1.43 

0.05 

30860 

C 

0 

15 

25 

1.03 

0.21 

1.82 

0.18 

30860 

D 

0 

8 

13 

0.03 

0.25 

0.64 

-0.31 

30861 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

30861 

A 

1 

20 

35 

1.10 

0.31 

1.51 

0.18 

30861 

B 

0 

2 

4 

1.58 

0.07 

2.04 

0.13 

30861 

C 

0 

31 

54 

0.77 

0.14 

1.25 

-0.06 

30861 

D 

0 

4 

7 

-0.42 

0.70 

0.47 

-0.31 

30862 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.02 

30862 

A 

1 

36 

60 

1.15 

0.17 

1.41 

0.23 

30862 

B 

0 

3 

5 

0.33 

0.70 

0.93 

-0.14 

30862 

C 

0 

14 

23 

0.79 

0.28 

1.31 

-0.09 

30862 

D 

0 

7 

12 

0.59 

0.33 

0.95 

-0.13 

30863 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.01 

30863 

A 

1 

13 

23 

1.94 

0.49 

1.15 

0.39 

30863 

B 

0 

22 

39 

0.75 

0.19 

0.97 

-0.24 

30863 

C 

0 

18 

32 

0.89 

0.20 

1.06 

-0.12 

30863 

D 

0 

3 

5 

1.28 

0.45 

1.38 

0.04 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30864 

* 

-1 

4955 

99 

1.21 

0.02 

0.00 

0.04 

30864 

A 

1 

35 

90 

0.69 

0.22 

1.03 

0.26 

30864 

B 

0 

4 

10 

-0.39 

0.45 

0.83 

-0.26 

30864 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30864 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30865 

* 

-1 

4951 

99 

1.21 

0.02 

0.00 

0.05 

30865 

A 

1 

40 

93 

0.61 

0.13 

0.84 

0.48 

30865 

B 

0 

1 

2 

-0.45 

0.00 

0.58 

-0.15 

30865 

C 

0 

1 

2 

-0.95 

0.00 

0.35 

-0.24 

30865 

D 

0 

1 

2 

-2.09 

0.00 

0.11 

-0.43 

30866 

* 

-1 

4933 

99 

1.21 

0.02 

0.00 

0.02 

30866 

A 

1 

52 

85 

1.03 

0.12 

1.01 

0.31 

30866 

B 

0 

7 

11 

0.55 

0.27 

1.17 

-0.13 

30866 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30866 

D 

0 

2 

3 

-1.04 

0.52 

0.22 

-0.38 

30867 

* 

-1 

4933 

99 

1.21 

0.02 

0.00 

0.04 

30867 

A 

1 

19 

31 

1.10 

0.19 

1.14 

0.25 

30867 

B 

0 

37 

61 

0.60 

0.15 

1.11 

-0.23 

30867 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30867 

D 

0 

5 

8 

0.76 

0.32 

1.07 

0.00 

30868 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.05 

30868 

A 

1 

49 

89 

0.70 

0.19 

0.96 

0.33 

30868 

B 

0 

3 

5 

0.06 

0.18 

1.12 

-0.09 

30868 

C 

0 

2 

4 

-1.14 

0.15 

0.33 

-0.24 

30868 

D 

0 

1 

2 

-2.29 

0.00 

0.10 

-0.28 

30869 

* 

-1 

4942 

99 

1.21 

0.02 

0.00 

0.02 

30869 

A 

1 

49 

94 

1.08 

0.16 

0.80 

0.43 

30869 

B 

0 

1 

2 

-1.28 

0.00 

0.19 

-0.26 

30869 

C 

0 

1 

2 

0.18 

0.00 

0.80 

-0.09 

30869 

D 

0 

1 

2 

-2.27 

0.00 

0.07 

-0.38 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30870 

* 

-1 

4937 

99 

1.22 

0.02 

0.00 

0.07 

30870 

A 

1 

53 

93 

0.54 

0.11 

0.69 

0.59 

30870 

B 

0 

2 

4 

-1.58 

0.89 

0.33 

-0.34 

30870 

C 

0 

1 

2 

-4.04 

0.00 

0.02 

-0.54 

30870 

D 

0 

1 

2 

-0.61 

0.00 

0.62 

-0.12 

30871 

* 

-1 

4953 

99 

1.21 

0.02 

0.00 

0.02 

30871 

A 

1 

36 

88 

1.01 

0.16 

1.08 

0.08 

30871 

B 

0 

2 

5 

0.56 

0.52 

0.99 

-0.10 

30871 

C 

0 

2 

5 

0.73 

0.75 

1.33 

-0.06 

30871 

D 

0 

1 

2 

1.26 

0.00 

1.75 

0.05 

30872 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.03 

30872 

A 

1 

44 

83 

0.90 

0.17 

1.35 

0.27 

30872 

B 

0 

3 

6 

0.58 

0.20 

1.23 

-0.04 

30872 

C 

0 

4 

8 

0.38 

0.50 

1.38 

-0.10 

30872 

D 

0 

2 

4 

-1.24 

0.49 

0.21 

-0.36 

30873 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.05 

30873 

A 

1 

58 

98 

0.65 

0.12 

1.01 

0.08 

30873 

B 

0 

1 

2 

0.11 

0.00 

0.83 

-0.08 

30873 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30873 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30874 

* 

-1 

4949 

99 

1.21 

0.02 

0.00 

0.04 

30874 

A 

1 

41 

91 

0.78 

0.18 

0.99 

0.27 

30874 

B 

0 

2 

4 

-0.29 

0.34 

0.65 

-0.18 

30874 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30874 

D 

0 

2 

4 

-0.36 

1.27 

1.09 

-0.19 

30875 

* 

-1 

4728 

95 

1.19 

0.02 

0.00 

-0.05 

30875 

A 

1 

253 

95 

1.58 

0.07 

0.94 

0.32 

30875 

B 

0 

7 

3 

-0.04 

0.29 

0.52 

-0.21 

30875 

C 

0 

6 

2 

-0.47 

0.41 

0.35 

-0.25 

30875 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30876 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.01 

30876 

A 

1 

37 

64 

1.33 

0.18 

1.35 

0.24 

30876 

B 

0 

7 

12 

0.88 

0.40 

1.26 

-0.09 

30876 

C 

0 

11 

19 

0.72 

0.29 

1.08 

-0.19 

30876 

D 

0 

3 

5 

0.82 

0.60 

1.08 

-0.07 

30877 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.05 

30877 

A 

1 

55 

93 

0.73 

0.14 

0.95 

0.32 

30877 

B 

0 

1 

2 

0.05 

0.00 

0.94 

-0.07 

30877 

C 

0 

2 

3 

-0.26 

1.10 

1.16 

-0.15 

30877 

D 

0 

1 

2 

-2.27 

0.00 

0.09 

-0.34 

30878 

* 

-1 

4945 

99 

1.21 

0.02 

0.00 

0.04 

30878 

A 

1 

44 

90 

0.85 

0.15 

0.87 

0.36 

30878 

B 

0 

1 

2 

1.57 

0.00 

3.84 

0.10 

30878 

C 

0 

2 

4 

0.04 

0.42 

0.91 

-0.11 

30878 

D 

0 

2 

4 

-2.30 

1.99 

0.30 

-0.51 

30879 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.02 

30879 

A 

1 

34 

59 

1.19 

0.17 

1.07 

0.29 

30879 

B 

0 

4 

7 

0.60 

0.37 

0.90 

-0.10 

30879 

C 

0 

16 

28 

0.69 

0.22 

1.14 

-0.17 

30879 

D 

0 

4 

7 

0.40 

0.62 

1.01 

-0.16 

30880 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.04 

30880 

A 

1 

15 

26 

1.53 

0.34 

1.11 

0.44 

30880 

B 

0 

17 

29 

0.91 

0.22 

1.77 

0.12 

30880 

C 

0 

15 

26 

0.05 

0.20 

0.56 

-0.35 

30880 

D 

0 

11 

19 

0.13 

0.21 

0.57 

-0.25 

30881 

* 

-1 

4935 

99 

1.22 

0.02 

0.00 

0.08 

30881 

A 

1 

27 

46 

0.51 

0.19 

1.52 

0.19 

30881 

B 

0 

10 

17 

0.15 

0.56 

1.56 

-0.06 

30881 

C 

0 

4 

7 

0.29 

0.40 

1.23 

0.00 

30881 

D 

0 

18 

31 

0.02 

0.20 

0.89 

-0.16 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30882 

* 

-1 

4711 

94 

1.17 

0.02 

0.00 

-0.11 

30882 

A 

1 

191 

67 

2.21 

0.10 

1.11 

0.40 

30882 

B 

0 

66 

23 

1.19 

0.14 

1.42 

-0.24 

30882 

C 

0 

16 

6 

0.78 

0.23 

0.82 

-0.17 

30882 

D 

0 

10 

4 

-0.14 

0.27 

0.32 

-0.26 

30883 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.02 

30883 

A 

1 

32 

53 

1.49 

0.17 

0.87 

0.57 

30883 

B 

0 

19 

32 

0.53 

0.15 

0.88 

-0.24 

30883 

C 

0 

6 

10 

-0.28 

0.41 

0.43 

-0.36 

30883 

D 

0 

3 

5 

-0.56 

0.50 

0.29 

-0.31 

30884 

* 

-1 

4951 

99 

1.21 

0.02 

0.00 

0.03 

30884 

A 

1 

39 

91 

0.93 

0.16 

0.96 

0.44 

30884 

B 

0 

2 

5 

-1.16 

0.48 

0.25 

-0.39 

30884 

C 

0 

2 

5 

-0.32 

0.01 

0.52 

-0.22 

30884 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30885 

* 

-1 

4948 

99 

1.21 

0.02 

0.00 

0.05 

30885 

A 

1 

24 

52 

0.71 

0.21 

1.62 

0.17 

30885 

B 

0 

19 

41 

0.59 

0.22 

1.46 

0.05 

30885 

C 

0 

2 

4 

0.00 

0.03 

0.57 

-0.09 

30885 

D 

0 

1 

2 

-4.19 

0.00 

0.01 

-0.59 

30886 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.03 

30886 

A 

1 

7 

13 

1.52 

0.83 

2.86 

0.18 

30886 

B 

0 

11 

20 

0.86 

0.29 

0.92 

0.03 

30886 

C 

0 

32 

59 

0.97 

0.20 

1.49 

0.15 

30886 

D 

0 

4 

7 

-2.50 

1.29 

0.13 

-0.56 

30887 

* 

-1 

4955 

99 

1.21 

0.02 

0.00 

0.01 

30887 

A 

1 

14 

36 

1.04 

0.31 

1.69 

0.02 

30887 

B 

0 

3 

8 

0.64 

0.67 

0.85 

-0.10 

30887 

C 

0 

20 

51 

1.14 

0.25 

1.74 

0.11 

30887 

D 

0 

2 

5 

0.09 

1.03 

0.56 

-0.19 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30888 

* 

-1 

4930 

99 

1.21 

0.02 

0.00 

0.03 

30888 

A 

1 

60 

94 

0.92 

0.20 

1.08 

0.18 

30888 

B 

0 

2 

3 

-0.58 

0.50 

0.56 

-0.17 

30888 

C 

0 

1 

2 

1.05 

0.00 

2.52 

0.02 

30888 

D 

0 

1 

2 

-0.69 

0.00 

0.44 

-0.13 

30889 

* 

-1 

4948 

99 

1.21 

0.02 

0.00 

0.01 

30889 

A 

1 

43 

93 

1.14 

0.22 

1.01 

0.17 

30889 

B 

0 

3 

7 

0.19 

0.57 

1.01 

-0.17 

30889 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30889 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30890 

* 

-1 

4955 

99 

1.21 

0.02 

0.00 

0.03 

30890 

A 

1 

31 

79 

0.92 

0.12 

0.87 

0.38 

30890 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30890 

C 

0 

8 

21 

0.13 

0.43 

1.23 

-0.38 

30890 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30891 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

30891 

A 

1 

15 

27 

1.09 

0.34 

1.80 

0.22 

30891 

B 

0 

12 

21 

0.53 

0.23 

0.90 

-0.13 

30891 

C 

0 

3 

5 

1.16 

0.47 

1.53 

0.11 

30891 

D 

0 

26 

46 

0.63 

0.12 

0.91 

-0.14 

30892 

* 

-1 

4929 

99 

1.21 

0.02 

0.00 

0.04 

30892 

A 

1 

17 

26 

1.93 

0.28 

0.69 

0.59 

30892 

B 

0 

10 

15 

0.34 

0.22 

0.67 

-0.13 

30892 

C 

0 

10 

15 

0.61 

0.46 

1.49 

-0.04 

30892 

D 

0 

28 

43 

0.15 

0.15 

0.64 

-0.40 

30893 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.03 

30893 

A 

1 

22 

37 

1.20 

0.21 

1.23 

0.27 

30893 

B 

0 

8 

14 

0.93 

0.44 

1.65 

0.03 

30893 

C 

0 

10 

17 

0.59 

0.28 

0.94 

-0.13 

30893 

D 

0 

19 

32 

0.59 

0.19 

0.94 

-0.20 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30894 

* 

-1 

4931 

99 

1.21 

0.02 

0.00 

0.00 

30894 

A 

1 

33 

52 

1.63 

0.17 

0.90 

0.47 

30894 

B 

0 

23 

37 

0.90 

0.14 

0.95 

-0.18 

30894 

C 

0 

1 

2 

1.06 

0.00 

0.92 

-0.01 

30894 

D 

0 

6 

10 

-0.54 

0.45 

0.30 

-0.51 

30895 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.02 

30895 

A 

1 

14 

25 

1.91 

0.28 

0.95 

0.53 

30895 

B 

0 

19 

33 

0.67 

0.14 

0.68 

-0.25 

30895 

C 

0 

8 

14 

0.85 

0.31 

1.08 

-0.07 

30895 

D 

0 

16 

28 

0.71 

0.21 

0.83 

-0.19 

30896 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30896 

A 

1 

13 

23 

1.92 

0.35 

0.64 

0.48 

30896 

B 

0 

15 

27 

0.79 

0.19 

1.06 

0.01 

30896 

C 

0 

7 

13 

-0.01 

0.47 

0.62 

-0.22 

30896 

D 

0 

21 

38 

0.31 

0.29 

0.98 

-0.27 

30897 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.03 

30897 

A 

1 

39 

66 

1.26 

0.17 

0.93 

0.54 

30897 

B 

0 

3 

5 

0.01 

0.52 

0.70 

-0.16 

30897 

C 

0 

9 

15 

0.19 

0.26 

0.91 

-0.22 

30897 

D 

0 

8 

14 

-0.43 

0.34 

0.46 

-0.42 

30898 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.03 

30898 

A 

1 

30 

55 

1.18 

0.22 

1.06 

0.34 

30898 

B 

0 

14 

25 

0.78 

0.23 

1.36 

-0.03 

30898 

C 

0 

5 

9 

-0.14 

0.37 

0.54 

-0.27 

30898 

D 

0 

6 

11 

0.04 

0.34 

0.73 

-0.25 

30899 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30899 

A 

1 

29 

52 

1.32 

0.25 

1.09 

0.38 

30899 

B 

0 

5 

9 

0.77 

0.22 

1.11 

-0.02 

30899 

C 

0 

14 

25 

0.35 

0.18 

0.83 

-0.25 

30899 

D 

0 

8 

14 

0.21 

0.49 

0.98 

-0.22 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30900 

* 

-1 

4692 

94 

1.17 

0.02 

0.00 

-0.09 

30900 

A 

1 

158 

52 

2.28 

0.10 

1.07 

0.48 

30900 

B 

0 

119 

39 

1.14 

0.09 

1.02 

-0.35 

30900 

C 

0 

16 

5 

0.90 

0.21 

0.71 

-0.15 

30900 

D 

0 

9 

3 

-0.02 

0.17 

0.22 

-0.23 

30901 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.05 

30901 

A 

1 

28 

48 

1.20 

0.23 

0.98 

0.49 

30901 

B 

0 

2 

3 

0.97 

0.67 

1.84 

0.06 

30901 

C 

0 

13 

22 

0.29 

0.26 

0.99 

-0.12 

30901 

D 

0 

15 

26 

-0.41 

0.24 

0.59 

-0.47 

30902 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.02 

30902 

A 

1 

36 

63 

1.31 

0.17 

0.96 

0.46 

30902 

B 

0 

11 

19 

0.47 

0.26 

0.99 

-0.23 

30902 

C 

0 

8 

14 

0.35 

0.19 

0.71 

-0.23 

30902 

D 

0 

2 

4 

-0.51 

0.21 

0.27 

-0.27 

30903 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

30903 

A 

1 

18 

32 

1.51 

0.21 

0.81 

0.42 

30903 

B 

0 

14 

25 

0.44 

0.19 

0.78 

-0.11 

30903 

C 

0 

3 

5 

0.92 

0.97 

1.76 

0.04 

30903 

D 

0 

22 

39 

0.14 

0.35 

0.96 

-0.32 

30904 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.02 

30904 

A 

1 

18 

32 

1.84 

0.36 

0.96 

0.50 

30904 

B 

0 

2 

4 

0.59 

0.24 

0.68 

-0.06 

30904 

C 

0 

26 

46 

0.73 

0.17 

1.09 

-0.16 

30904 

D 

0 

10 

18 

-0.04 

0.16 

0.39 

-0.37 

30905 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

30905 

A 

1 

13 

23 

1.58 

0.38 

1.17 

0.40 

30905 

B 

0 

9 

16 

0.57 

0.24 

0.81 

-0.06 

30905 

C 

0 

12 

21 

0.55 

0.31 

0.98 

-0.08 

30905 

D 

0 

22 

39 

0.41 

0.22 

0.84 

-0.23 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30906 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30906 

A 

1 

20 

36 

1.77 

0.18 

0.66 

0.50 

30906 

B 

0 

4 

7 

0.76 

0.57 

1.02 

-0.01 

30906 

C 

0 

18 

32 

0.62 

0.22 

0.97 

-0.10 

30906 

D 

0 

14 

25 

-0.24 

0.49 

0.58 

-0.44 

30907 

* 

-1 

4954 

99 

1.21 

0.02 

0.00 

0.01 

30907 

A 

1 

36 

90 

1.11 

0.14 

0.95 

0.35 

30907 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30907 

C 

0 

1 

3 

0.41 

0.00 

0.76 

-0.11 

30907 

D 

0 

3 

8 

-0.06 

0.64 

0.66 

-0.33 

30908 

* 

-1 

4948 

99 

1.21 

0.02 

0.00 

0.04 

30908 

A 

1 

19 

41 

1.28 

0.25 

1.04 

0.51 

30908 

B 

0 

19 

41 

0.24 

0.16 

0.76 

-0.36 

30908 

C 

0 

3 

7 

-0.11 

0.74 

0.72 

-0.20 

30908 

D 

0 

5 

11 

0.46 

0.20 

0.82 

-0.07 

30909 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.02 

30909 

A 

1 

35 

64 

1.28 

0.23 

1.12 

0.39 

30909 

B 

0 

5 

9 

-0.14 

0.44 

0.55 

-0.27 

30909 

C 

0 

9 

16 

0.56 

0.22 

1.13 

-0.12 

30909 

D 

0 

6 

11 

0.19 

0.31 

0.73 

-0.20 

30910 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.06 

30910 

A 

1 

35 

59 

0.91 

0.14 

0.82 

0.55 

30910 

B 

0 

12 

20 

-0.09 

0.26 

0.83 

-0.29 

30910 

C 

0 

7 

12 

-0.11 

0.19 

0.67 

-0.22 

30910 

D 

0 

5 

8 

-0.47 

0.49 

0.64 

-0.29 

30911 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.03 

30911 

A 

1 

44 

81 

0.91 

0.15 

1.08 

0.18 

30911 

B 

0 

1 

2 

0.55 

0.00 

0.96 

-0.04 

30911 

C 

0 

2 

4 

0.22 

0.51 

0.78 

-0.13 

30911 

D 

0 

7 

13 

0.54 

0.30 

1.14 

-0.12 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30912 

* 

-1 

4952 

99 

1.21 

0.02 

0.00 

0.02 

30912 

A 

1 

33 

79 

1.23 

0.23 

1.03 

0.39 

30912 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30912 

C 

0 

5 

12 

0.56 

0.31 

1.26 

-0.11 

30912 

D 

0 

4 

10 

-0.78 

0.22 

0.29 

-0.42 

30913 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

30913 

A 

1 

32 

56 

1.15 

0.16 

0.95 

0.44 

30913 

B 

0 

8 

14 

0.50 

0.33 

1.09 

-0.11 

30913 

C 

0 

8 

14 

0.38 

0.22 

0.86 

-0.16 

30913 

D 

0 

9 

16 

-0.02 

0.33 

0.68 

-0.35 

30914 

* 

-1 

4700 

94 

1.17 

0.02 

0.00 

-0.11 

30914 

A 

1 

259 

88 

1.98 

0.08 

0.95 

0.37 

30914 

B 

0 

14 

5 

0.41 

0.23 

0.59 

-0.23 

30914 

C 

0 

10 

3 

0.83 

0.30 

1.04 

-0.13 

30914 

D 

0 

11 

4 

0.06 

0.21 

0.39 

-0.25 

30915 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.02 

30915 

A 

1 

40 

69 

1.06 

0.17 

1.41 

0.15 

30915 

B 

0 

4 

7 

0.96 

0.45 

1.63 

0.00 

30915 

C 

0 

4 

7 

0.15 

0.23 

0.57 

-0.21 

30915 

D 

0 

10 

17 

0.85 

0.34 

1.74 

-0.05 

30916 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.03 

30916 

A 

1 

11 

20 

1.77 

0.36 

1.02 

0.44 

30916 

B 

0 

7 

13 

0.29 

0.27 

0.54 

-0.16 

30916 

C 

0 

27 

49 

0.57 

0.21 

0.97 

-0.17 

30916 

D 

0 

10 

18 

0.53 

0.31 

0.87 

-0.10 

30917 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.04 

30917 

A 

1 

42 

71 

1.06 

0.21 

3.39 

0.40 

30917 

B 

0 

4 

7 

0.36 

0.44 

1.20 

-0.07 

30917 

C 

0 

2 

3 

-0.20 

0.19 

0.52 

-0.13 

30917 

D 

0 

11 

19 

-0.32 

0.28 

0.65 

-0.37 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30918 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.04 

30918 

A 

1 

39 

74 

1.05 

0.21 

1.32 

0.42 

30918 

B 

0 

4 

8 

-0.35 

0.73 

1.09 

-0.23 

30918 

C 

0 

8 

15 

-0.02 

0.28 

0.87 

-0.23 

30918 

D 

0 

2 

4 

-0.67 

0.95 

0.52 

-0.21 

30919 

* 

-1 

4942 

99 

1.21 

0.02 

0.00 

0.03 

30919 

A 

1 

19 

37 

1.65 

0.28 

0.75 

0.54 

30919 

B 

0 

22 

42 

0.29 

0.21 

0.86 

-0.31 

30919 

C 

0 

7 

13 

0.16 

0.46 

0.86 

-0.19 

30919 

D 

0 

4 

8 

0.06 

0.46 

0.62 

-0.16 

30920 

* 

-1 

4942 

99 

1.21 

0.02 

0.00 

0.04 

30920 

A 

1 

16 

31 

0.89 

0.30 

1.97 

0.16 

30920 

B 

0 

4 

8 

0.93 

0.40 

1.35 

0.08 

30920 

C 

0 

21 

40 

0.84 

0.15 

1.23 

0.15 

30920 

D 

0 

11 

21 

-0.17 

0.34 

0.53 

-0.41 

30921 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

30921 

A 

1 

40 

70 

1.19 

0.16 

0.86 

0.51 

30921 

B 

0 

2 

4 

0.05 

0.80 

0.76 

-0.13 

30921 

C 

0 

11 

19 

0.15 

0.18 

0.73 

-0.29 

30921 

D 

0 

4 

7 

-0.64 

0.75 

0.57 

-0.36 

30922 

* 

-1 

4932 

99 

1.21 

0.02 

0.00 

0.06 

30922 

A 

1 

46 

74 

0.72 

0.13 

0.97 

0.35 

30922 

B 

0 

2 

3 

0.35 

0.52 

1.12 

-0.04 

30922 

C 

0 

8 

13 

0.23 

0.27 

1.12 

-0.13 

30922 

D 

0 

6 

10 

-0.46 

0.47 

0.66 

-0.35 

30923 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.04 

30923 

A 

1 

27 

47 

1.06 

0.22 

1.41 

0.26 

30923 

B 

0 

4 

7 

1.15 

0.40 

1.82 

0.10 

30923 

C 

0 

5 

9 

0.90 

0.43 

1.53 

0.04 

30923 

D 

0 

22 

38 

0.27 

0.21 

1.02 

-0.35 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30924 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.02 

30924 

A 

1 

53 

93 

1.11 

0.16 

0.82 

0.36 

30924 

B 

0 

2 

4 

0.38 

0.81 

1.43 

-0.08 

30924 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30924 

D 

0 

2 

4 

-1.99 

2.06 

0.39 

-0.42 

30925 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.03 

30925 

A 

1 

29 

49 

1.36 

0.22 

1.14 

0.44 

30925 

B 

0 

11 

19 

0.76 

0.29 

1.35 

-0.03 

30925 

C 

0 

4 

7 

-0.10 

0.60 

0.72 

-0.21 

30925 

D 

0 

15 

25 

0.07 

0.25 

0.69 

-0.36 

30926 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.02 

30926 

A 

1 

22 

39 

1.34 

0.28 

1.13 

0.29 

30926 

B 

0 

1 

2 

4.56 

0.00 

40.05 

0.41 

30926 

C 

0 

8 

14 

0.87 

0.12 

1.07 

-0.01 

30926 

D 

0 

26 

46 

0.40 

0.17 

1.00 

-0.39 

30927 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.03 

30927 

A 

1 

18 

33 

2.07 

0.28 

0.57 

0.66 

30927 

B 

0 

8 

15 

0.36 

0.37 

0.89 

-0.14 

30927 

C 

0 

19 

35 

0.34 

0.23 

0.79 

-0.26 

30927 

D 

0 

10 

18 

-0.16 

0.20 

0.40 

-0.35 

30928 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.03 

30928 

A 

1 

36 

62 

1.06 

0.19 

1.19 

0.22 

30928 

B 

0 

8 

14 

0.74 

0.15 

1.06 

-0.05 

30928 

C 

0 

13 

22 

0.70 

0.18 

1.13 

-0.09 

30928 

D 

0 

1 

2 

-2.27 

0.00 

0.05 

-0.40 

30929 

* 

-1 

4691 

94 

1.18 

0.02 

0.00 

-0.08 

30929 

A 

1 

199 

66 

2.15 

0.08 

0.88 

0.54 

30929 

B 

0 

50 

17 

0.62 

0.10 

0.58 

-0.33 

30929 

C 

0 

43 

14 

0.92 

0.15 

1.06 

-0.21 

30929 

D 

0 

11 

4 

-0.68 

0.48 

0.24 

-0.33 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30930 

* 

-1 

4933 

99 

1.21 

0.02 

0.00 

0.04 

30930 

A 

1 

28 

46 

1.31 

0.19 

0.92 

0.44 

30930 

B 

0 

17 

28 

0.54 

0.26 

1.58 

-0.12 

30930 

C 

0 

4 

7 

0.59 

0.67 

1.43 

-0.04 

30930 

D 

0 

12 

20 

-0.13 

0.25 

0.54 

-0.39 

30931 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.05 

30931 

A 

1 

21 

36 

1.41 

0.29 

1.07 

0.50 

30931 

B 

0 

12 

20 

-0.01 

0.23 

0.62 

-0.29 

30931 

C 

0 

15 

25 

0.57 

0.19 

1.06 

-0.04 

30931 

D 

0 

11 

19 

0.00 

0.21 

0.59 

-0.27 

30932 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30932 

A 

1 

48 

86 

0.96 

0.20 

1.24 

0.20 

30932 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30932 

C 

0 

5 

9 

0.56 

0.36 

1.57 

-0.07 

30932 

D 

0 

3 

5 

-0.36 

0.13 

0.50 

-0.22 

30933 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

30933 

A 

1 

37 

65 

1.10 

0.13 

0.79 

0.57 

30933 

B 

0 

1 

2 

-0.71 

0.00 

0.28 

-0.19 

30933 

C 

0 

15 

26 

0.08 

0.20 

0.79 

-0.36 

30933 

D 

0 

4 

7 

-0.55 

0.58 

0.46 

-0.34 

30934 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.01 

30934 

A 

1 

47 

84 

1.27 

0.13 

0.88 

0.43 

30934 

B 

0 

6 

11 

0.16 

0.22 

0.60 

-0.33 

30934 

C 

0 

3 

5 

0.00 

0.71 

0.74 

-0.26 

30934 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30935 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.04 

30935 

A 

1 

34 

64 

1.08 

0.17 

0.95 

0.51 

30935 

B 

0 

5 

9 

-0.10 

0.43 

0.84 

-0.22 

30935 

C 

0 

10 

19 

-0.11 

0.31 

0.77 

-0.33 

30935 

D 

0 

4 

8 

-0.13 

0.56 

0.81 

-0.20 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30936 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.05 

30936 

A 

1 

41 

77 

0.98 

0.13 

0.71 

0.66 

30936 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30936 

C 

0 

2 

4 

-0.97 

0.60 

0.33 

-0.28 

30936 

D 

0 

10 

19 

-0.69 

0.29 

0.52 

-0.57 

30937 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.04 

30937 

A 

1 

31 

53 

1.23 

0.18 

1.08 

0.51 

30937 

B 

0 

2 

3 

0.81 

0.05 

1.12 

0.02 

30937 

C 

0 

10 

17 

0.31 

0.27 

0.87 

-0.17 

30937 

D 

0 

16 

27 

-0.05 

0.20 

0.66 

-0.44 

30938 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.05 

30938 

A 

1 

28 

50 

1.44 

0.20 

0.73 

0.57 

30938 

B 

0 

13 

23 

0.48 

0.23 

1.07 

-0.05 

30938 

C 

0 

6 

11 

-0.54 

0.24 

0.34 

-0.28 

30938 

D 

0 

9 

16 

-1.01 

0.61 

0.40 

-0.49 

30939 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.03 

30939 

A 

1 

31 

53 

1.43 

0.18 

0.85 

0.51 

30939 

B 

0 

14 

24 

-0.04 

0.43 

1.00 

-0.39 

30939 

C 

0 

2 

3 

0.77 

0.79 

1.28 

-0.01 

30939 

D 

0 

11 

19 

0.23 

0.17 

0.65 

-0.23 

30940 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.03 

30940 

A 

1 

24 

44 

1.56 

0.17 

0.69 

0.65 

30940 

B 

0 

7 

13 

0.39 

0.19 

0.71 

-0.15 

30940 

C 

0 

16 

29 

0.17 

0.23 

0.78 

-0.39 

30940 

D 

0 

8 

15 

0.12 

0.26 

0.61 

-0.27 

30941 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.03 

30941 

A 

1 

32 

54 

1.40 

0.14 

0.69 

0.64 

30941 

B 

0 

4 

7 

0.43 

0.50 

1.04 

-0.09 

30941 

C 

0 

7 

12 

0.09 

0.24 

0.60 

-0.25 

30941 

D 

0 

16 

27 

-0.02 

0.21 

0.63 

-0.48 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30942 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.02 

30942 

A 

1 

30 

55 

1.41 

0.20 

1.03 

0.46 

30942 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30942 

C 

0 

12 

22 

0.42 

0.23 

0.84 

-0.27 

30942 

D 

0 

13 

24 

0.43 

0.24 

0.89 

-0.28 

30943 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.02 

30943 

A 

1 

35 

63 

1.42 

0.21 

1.06 

0.44 

30943 

B 

0 

4 

7 

0.80 

0.43 

1.23 

-0.05 

30943 

C 

0 

9 

16 

0.37 

0.17 

0.68 

-0.23 

30943 

D 

0 

8 

14 

0.08 

0.36 

0.69 

-0.32 

30944 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.01 

30944 

A 

1 

30 

53 

1.57 

0.21 

0.89 

0.44 

30944 

B 

0 

7 

12 

-0.03 

0.33 

0.48 

-0.35 

30944 

C 

0 

5 

9 

0.79 

0.38 

1.11 

-0.07 

30944 

D 

0 

15 

26 

0.69 

0.28 

1.26 

-0.19 

30945 

* 

-1 

4946 

99 

1.21 

0.02 

0.00 

0.03 

30945 

A 

1 

34 

71 

1.11 

0.17 

0.87 

0.45 

30945 

B 

0 

8 

17 

0.20 

0.31 

0.92 

-0.23 

30945 

C 

0 

1 

2 

-0.20 

0.00 

0.45 

-0.13 

30945 

D 

0 

5 

10 

-0.30 

0.77 

0.81 

-0.32 

30946 

* 

-1 

4932 

99 

1.22 

0.02 

0.00 

0.06 

30946 

A 

1 

27 

44 

0.73 

0.19 

1.18 

0.24 

30946 

B 

0 

23 

37 

0.40 

0.21 

1.54 

-0.03 

30946 

C 

0 

7 

11 

0.26 

0.32 

1.10 

-0.06 

30946 

D 

0 

5 

8 

-0.64 

0.64 

0.66 

-0.31 

30947 

* 

-1 

4932 

99 

1.21 

0.02 

0.00 

0.02 

30947 

A 

1 

37 

60 

1.49 

0.18 

0.96 

0.50 

30947 

B 

0 

12 

19 

0.52 

0.20 

0.88 

-0.18 

30947 

C 

0 

10 

16 

0.12 

0.45 

1.08 

-0.30 

30947 

D 

0 

3 

5 

-0.76 

0.10 

0.20 

-0.31 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30948 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.05 

30948 

A 

1 

16 

30 

0.95 

0.38 

1.28 

0.23 

30948 

B 

0 

20 

38 

0.47 

0.28 

1.84 

-0.02 

30948 

C 

0 

7 

13 

0.19 

0.50 

1.13 

-0.09 

30948 

D 

0 

10 

19 

0.06 

0.25 

0.83 

-0.17 

30949 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.05 

30949 

A 

1 

51 

89 

0.77 

0.13 

0.92 

0.50 

30949 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30949 

C 

0 

1 

2 

-1.56 

0.00 

0.16 

-0.21 

30949 

D 

0 

5 

9 

-1.35 

1.18 

0.72 

-0.45 

30950 

* 

-1 

4933 

99 

1.21 

0.02 

0.00 

0.03 

30950 

A 

1 

55 

90 

1.05 

0.13 

0.86 

0.41 

30950 

B 

0 

1 

2 

0.66 

0.00 

1.15 

-0.03 

30950 

C 

0 

3 

5 

-0.12 

0.31 

0.58 

-0.22 

30950 

D 

0 

2 

3 

-1.42 

0.54 

0.17 

-0.40 

30951 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.02 

30951 

A 

1 

37 

69 

1.53 

0.18 

0.73 

0.66 

30951 

B 

0 

3 

6 

-0.44 

0.75 

0.60 

-0.23 

30951 

C 

0 

6 

11 

-1.24 

0.39 

0.23 

-0.53 

30951 

D 

0 

8 

15 

0.09 

0.29 

0.71 

-0.24 

30952 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

30952 

A 

1 

34 

60 

1.26 

0.24 

1.99 

0.45 

30952 

B 

0 

4 

7 

0.70 

0.43 

1.44 

-0.01 

30952 

C 

0 

4 

7 

-0.13 

0.49 

0.65 

-0.18 

30952 

D 

0 

15 

26 

-0.12 

0.24 

0.72 

-0.39 

30953 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.06 

30953 

A 

1 

28 

47 

0.95 

0.13 

0.79 

0.44 

30953 

B 

0 

6 

10 

0.29 

0.31 

1.06 

-0.06 

30953 

C 

0 

13 

22 

0.51 

0.32 

1.76 

0.02 

30953 

D 

0 

13 

22 

-0.51 

0.28 

0.52 

-0.51 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30954 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.04 

30954 

A 

1 

28 

48 

1.18 

0.18 

0.94 

0.49 

30954 

B 

0 

12 

21 

0.62 

0.20 

1.15 

-0.03 

30954 

C 

0 

8 

14 

0.14 

0.25 

0.72 

-0.22 

30954 

D 

0 

10 

17 

-0.21 

0.23 

0.53 

-0.42 

30955 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

30955 

A 

1 

17 

30 

1.13 

0.20 

1.05 

0.29 

30955 

B 

0 

21 

37 

0.69 

0.20 

1.18 

-0.03 

30955 

C 

0 

2 

4 

0.41 

0.56 

0.73 

-0.06 

30955 

D 

0 

17 

30 

0.39 

0.23 

0.86 

-0.24 

30956 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.01 

30956 

A 

1 

36 

64 

1.63 

0.23 

0.94 

0.48 

30956 

B 

0 

5 

9 

0.35 

0.42 

0.84 

-0.18 

30956 

C 

0 

6 

11 

0.36 

0.23 

0.69 

-0.19 

30956 

D 

0 

9 

16 

0.10 

0.44 

0.83 

-0.33 

30957 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.04 

30957 

A 

1 

23 

42 

1.24 

0.24 

1.17 

0.39 

30957 

B 

0 

4 

7 

-0.21 

0.88 

0.86 

-0.23 

30957 

C 

0 

10 

18 

0.54 

0.38 

1.50 

-0.07 

30957 

D 

0 

18 

33 

0.34 

0.16 

0.79 

-0.23 

30958 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.02 

30958 

A 

1 

19 

36 

1.48 

0.35 

2.14 

0.37 

30958 

B 

0 

8 

15 

0.71 

0.22 

0.96 

-0.07 

30958 

C 

0 

7 

13 

0.83 

0.23 

1.04 

-0.02 

30958 

D 

0 

19 

36 

0.43 

0.19 

0.81 

-0.30 

30959 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.03 

30959 

A 

1 

28 

48 

1.28 

0.18 

0.95 

0.45 

30959 

B 

0 

11 

19 

0.49 

0.25 

0.96 

-0.13 

30959 

C 

0 

5 

9 

0.30 

0.31 

0.71 

-0.14 

30959 

D 

0 

14 

24 

0.18 

0.32 

0.81 

-0.31 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30960 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.04 

30960 

A 

1 

34 

58 

1.02 

0.12 

0.89 

0.42 

30960 

B 

0 

8 

14 

0.34 

0.33 

1.00 

-0.16 

30960 

C 

0 

8 

14 

0.43 

0.26 

0.95 

-0.12 

30960 

D 

0 

9 

15 

0.02 

0.42 

0.95 

-0.32 

30961 

* 

-1 

4944 

99 

1.21 

0.02 

0.00 

0.03 

30961 

A 

1 

22 

44 

1.32 

0.23 

1.07 

0.39 

30961 

B 

0 

15 

30 

0.50 

0.32 

1.26 

-0.18 

30961 

C 

0 

10 

20 

0.52 

0.26 

0.93 

-0.13 

30961 

D 

0 

3 

6 

-0.22 

0.70 

0.56 

-0.23 

30962 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.04 

30962 

A 

1 

16 

27 

1.15 

0.32 

1.61 

0.23 

30962 

B 

0 

8 

13 

0.78 

0.33 

1.13 

0.00 

30962 

C 

0 

31 

52 

0.77 

0.14 

1.06 

0.00 

30962 

D 

0 

5 

8 

-0.45 

0.25 

0.27 

-0.36 

30963 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.03 

30963 

A 

1 

16 

30 

1.66 

0.28 

0.84 

0.44 

30963 

B 

0 

14 

26 

0.61 

0.23 

0.86 

-0.13 

30963 

C 

0 

16 

30 

0.60 

0.27 

1.06 

-0.16 

30963 

D 

0 

7 

13 

0.23 

0.53 

0.79 

-0.22 

30964 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.01 

30964 

A 

1 

51 

86 

1.11 

0.14 

1.04 

0.19 

30964 

B 

0 

1 

2 

0.70 

0.00 

1.00 

-0.04 

30964 

C 

0 

5 

8 

0.37 

0.48 

1.18 

-0.20 

30964 

D 

0 

2 

3 

0.89 

0.77 

1.58 

-0.03 

30965 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.04 

30965 

A 

1 

35 

58 

1.09 

0.18 

1.03 

0.40 

30965 

B 

0 

12 

20 

0.29 

0.20 

0.88 

-0.24 

30965 

C 

0 

3 

5 

0.31 

0.52 

0.87 

-0.11 

30965 

D 

0 

10 

17 

0.30 

0.20 

0.82 

-0.21 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30966 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.03 

30966 

A 

1 

8 

15 

1.73 

0.77 

2.77 

0.30 

30966 

B 

0 

10 

19 

0.70 

0.24 

0.71 

-0.06 

30966 

C 

0 

25 

46 

0.88 

0.18 

0.96 

0.01 

30966 

D 

0 

11 

20 

0.34 

0.32 

0.70 

-0.22 

30967 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.03 

30967 

A 

1 

33 

55 

1.37 

0.15 

0.86 

0.52 

30967 

B 

0 

6 

10 

-0.13 

0.27 

0.46 

-0.28 

30967 

C 

0 

7 

12 

0.62 

0.30 

0.98 

-0.06 

30967 

D 

0 

14 

23 

0.06 

0.38 

0.75 

-0.37 

30968 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.01 

30968 

A 

1 

34 

60 

1.54 

0.20 

0.87 

0.52 

30968 

B 

0 

8 

14 

0.50 

0.19 

0.78 

-0.18 

30968 

C 

0 

10 

18 

0.39 

0.29 

0.86 

-0.25 

30968 

D 

0 

5 

9 

-0.31 

0.36 

0.39 

-0.35 

30969 

* 

-1 

4946 

99 

1.21 

0.02 

0.00 

0.05 

30969 

A 

1 

27 

56 

1.23 

0.18 

0.72 

0.64 

30969 

B 

0 

6 

13 

-0.04 

0.21 

0.65 

-0.20 

30969 

C 

0 

6 

13 

-0.26 

0.45 

0.77 

-0.27 

30969 

D 

0 

9 

19 

-0.44 

0.35 

0.54 

-0.41 

30970 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.04 

30970 

A 

1 

18 

31 

1.14 

0.24 

1.16 

0.25 

30970 

B 

0 

10 

17 

0.74 

0.30 

1.29 

0.00 

30970 

C 

0 

12 

20 

0.67 

0.33 

1.55 

-0.04 

30970 

D 

0 

19 

32 

0.42 

0.23 

1.06 

-0.22 

30971 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

30971 

A 

1 

31 

54 

1.07 

0.15 

0.96 

0.34 

30971 

B 

0 

3 

5 

-0.10 

0.43 

0.53 

-0.20 

30971 

C 

0 

14 

25 

0.78 

0.32 

2.11 

0.02 

30971 

D 

0 

9 

16 

-0.10 

0.28 

0.59 

-0.36 

easyCBM  CCSS  Third  Grade  Math  Measure  Development 


388 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30972 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.06 

30972 

A 

1 

36 

64 

0.75 

0.19 

1.06 

0.31 

30972 

B 

0 

10 

18 

0.45 

0.18 

1.26 

-0.02 

30972 

C 

0 

3 

5 

-0.37 

0.54 

0.66 

-0.19 

30972 

D 

0 

7 

13 

-0.34 

0.40 

0.68 

-0.30 

30973 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.04 

30973 

A 

1 

42 

72 

0.90 

0.13 

1.03 

0.32 

30973 

B 

0 

8 

14 

0.31 

0.26 

0.93 

-0.20 

30973 

C 

0 

5 

9 

0.38 

0.40 

1.09 

-0.13 

30973 

D 

0 

3 

5 

0.09 

0.34 

0.68 

-0.18 

30974 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

30974 

A 

1 

37 

65 

1.06 

0.22 

1.08 

0.33 

30974 

B 

0 

10 

18 

0.58 

0.23 

1.30 

-0.06 

30974 

C 

0 

1 

2 

1.05 

0.00 

1.68 

0.03 

30974 

D 

0 

9 

16 

-0.38 

0.40 

0.64 

-0.38 

30975 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30975 

A 

1 

29 

52 

1.39 

0.20 

0.79 

0.53 

30975 

B 

0 

8 

14 

0.58 

0.38 

1.38 

-0.08 

30975 

C 

0 

6 

11 

0.35 

0.12 

0.70 

-0.14 

30975 

D 

0 

13 

23 

-0.15 

0.22 

0.55 

-0.46 

30976 

* 

-1 

4944 

99 

1.21 

0.02 

0.00 

0.04 

30976 

A 

1 

35 

70 

0.84 

0.15 

1.01 

0.29 

30976 

B 

0 

6 

12 

0.61 

0.32 

1.46 

-0.02 

30976 

C 

0 

3 

6 

0.56 

0.63 

1.60 

-0.03 

30976 

D 

0 

6 

12 

-0.26 

0.39 

0.68 

-0.38 

30977 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.03 

30977 

A 

1 

30 

55 

1.34 

0.18 

0.79 

0.53 

30977 

B 

0 

14 

25 

0.49 

0.26 

1.15 

-0.14 

30977 

C 

0 

7 

13 

-0.26 

0.26 

0.45 

-0.33 

30977 

D 

0 

4 

7 

-0.74 

0.78 

0.40 

-0.36 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30978 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

30978 

A 

1 

39 

68 

1.23 

0.23 

0.91 

0.45 

30978 

B 

0 

11 

19 

0.29 

0.18 

0.98 

-0.18 

30978 

C 

0 

1 

2 

-1.67 

0.00 

0.12 

-0.23 

30978 

D 

0 

6 

11 

-0.65 

0.39 

0.43 

-0.35 

30979 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

30979 

A 

1 

26 

46 

1.18 

0.19 

1.05 

0.43 

30979 

B 

0 

7 

12 

0.36 

0.35 

0.91 

-0.16 

30979 

C 

0 

5 

9 

0.78 

0.19 

1.08 

0.01 

30979 

D 

0 

19 

33 

0.30 

0.15 

0.78 

-0.35 

30980 

* 

-1 

4697 

94 

1.17 

0.02 

0.00 

-0.11 

30980 

A 

1 

111 

37 

2.47 

0.13 

1.18 

0.39 

30980 

B 

0 

62 

21 

1.50 

0.14 

1.29 

-0.12 

30980 

C 

0 

108 

36 

1.56 

0.10 

1.19 

-0.14 

30980 

D 

0 

16 

5 

0.00 

0.25 

0.21 

-0.33 

30981 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30981 

A 

1 

7 

13 

2.27 

0.92 

3.67 

0.41 

30981 

B 

0 

42 

75 

0.77 

0.14 

0.79 

-0.12 

30981 

C 

0 

4 

7 

0.45 

0.53 

0.59 

-0.09 

30981 

D 

0 

3 

5 

-0.63 

0.66 

0.18 

-0.27 

30982 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.00 

30982 

A 

1 

28 

50 

1.69 

0.21 

1.13 

0.44 

30982 

B 

0 

12 

21 

1.10 

0.29 

1.31 

-0.03 

30982 

C 

0 

2 

4 

1.62 

0.29 

1.59 

0.07 

30982 

D 

0 

14 

25 

0.14 

0.25 

0.52 

-0.50 

30983 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.05 

30983 

A 

1 

34 

60 

0.71 

0.16 

1.17 

0.19 

30983 

B 

0 

7 

12 

0.09 

0.43 

1.20 

-0.17 

30983 

C 

0 

8 

14 

1.10 

0.35 

2.92 

0.22 

30983 

D 

0 

8 

14 

-0.27 

0.30 

0.64 

-0.33 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30984 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.03 

30984 

A 

1 

36 

65 

0.86 

0.17 

1.40 

0.03 

30984 

B 

0 

3 

5 

0.12 

1.03 

1.13 

-0.16 

30984 

C 

0 

14 

25 

1.03 

0.32 

3.22 

0.11 

30984 

D 

0 

2 

4 

0.08 

0.09 

0.54 

-0.14 

30985 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.03 

30985 

A 

1 

28 

47 

1.48 

0.18 

0.73 

0.60 

30985 

B 

0 

14 

24 

0.29 

0.23 

0.91 

-0.27 

30985 

C 

0 

16 

27 

0.16 

0.17 

0.68 

-0.37 

30985 

D 

0 

1 

2 

-0.39 

0.00 

0.31 

-0.15 

30986 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

30986 

A 

1 

47 

84 

0.71 

0.14 

1.11 

-0.05 

30986 

B 

0 

4 

7 

1.10 

0.83 

5.42 

0.10 

30986 

C 

0 

1 

2 

2.32 

0.00 

6.64 

0.20 

30986 

D 

0 

4 

7 

0.26 

0.63 

1.46 

-0.13 

30987 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

30987 

A 

1 

4 

7 

1.67 

0.73 

1.27 

0.20 

30987 

B 

0 

7 

12 

0.66 

0.65 

1.01 

-0.05 

30987 

C 

0 

34 

60 

0.93 

0.17 

1.11 

0.12 

30987 

D 

0 

12 

21 

0.29 

0.29 

0.54 

-0.23 

30988 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

30988 

A 

1 

9 

16 

1.52 

0.74 

4.71 

0.24 

30988 

B 

0 

43 

75 

0.74 

0.15 

1.18 

-0.13 

30988 

C 

0 

1 

2 

0.27 

0.00 

0.37 

-0.06 

30988 

D 

0 

4 

7 

0.48 

0.34 

0.55 

-0.08 

30989 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.03 

30989 

A 

1 

14 

25 

1.61 

0.37 

1.28 

0.40 

30989 

B 

0 

2 

4 

-1.62 

0.26 

0.07 

-0.38 

30989 

C 

0 

30 

55 

0.88 

0.15 

1.14 

0.09 

30989 

D 

0 

9 

16 

-0.34 

0.26 

0.34 

-0.40 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30990 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.02 

30990 

A 

1 

46 

81 

1.05 

0.16 

1.09 

0.21 

30990 

B 

0 

4 

7 

0.47 

0.12 

0.84 

-0.13 

30990 

C 

0 

4 

7 

1.22 

0.34 

2.11 

0.07 

30990 

D 

0 

3 

5 

-0.44 

0.34 

0.37 

-0.32 

30991 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

30991 

A 

1 

23 

41 

1.39 

0.16 

0.81 

0.50 

30991 

B 

0 

14 

25 

0.34 

0.27 

0.89 

-0.20 

30991 

C 

0 

5 

9 

1.12 

0.12 

1.34 

0.11 

30991 

D 

0 

14 

25 

-0.13 

0.32 

0.64 

-0.44 

30992 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

30992 

A 

1 

18 

32 

1.57 

0.38 

2.01 

0.43 

30992 

B 

0 

9 

16 

-0.10 

0.43 

0.56 

-0.29 

30992 

C 

0 

18 

32 

0.47 

0.18 

0.81 

-0.15 

30992 

D 

0 

11 

20 

0.63 

0.23 

0.97 

-0.05 

30993 

* 

-1 

4947 

99 

1.21 

0.02 

0.00 

0.02 

30993 

A 

1 

23 

49 

1.61 

0.28 

0.90 

0.55 

30993 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30993 

C 

0 

9 

19 

0.18 

0.20 

0.60 

-0.30 

30993 

D 

0 

15 

32 

0.32 

0.17 

0.71 

-0.34 

30994 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.02 

30994 

A 

1 

16 

28 

1.55 

0.20 

0.85 

0.41 

30994 

B 

0 

2 

4 

0.76 

0.46 

0.78 

-0.04 

30994 

C 

0 

26 

46 

1.01 

0.14 

1.09 

0.05 

30994 

D 

0 

13 

23 

0.19 

0.24 

0.56 

-0.48 

30995 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.02 

30995 

A 

1 

40 

70 

1.25 

0.17 

0.84 

0.46 

30995 

B 

0 

1 

2 

0.27 

0.00 

0.63 

-0.08 

30995 

C 

0 

3 

5 

0.17 

0.28 

0.62 

-0.16 

30995 

D 

0 

13 

23 

0.13 

0.26 

0.76 

-0.39 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30996 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.05 

30996 

A 

1 

18 

32 

0.92 

0.34 

2.19 

0.17 

30996 

B 

0 

14 

25 

0.67 

0.19 

1.14 

0.01 

30996 

C 

0 

11 

20 

0.61 

0.38 

2.97 

-0.01 

30996 

D 

0 

13 

23 

0.24 

0.21 

0.75 

-0.19 

30997 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.04 

30997 

A 

1 

15 

28 

1.37 

0.22 

0.88 

0.40 

30997 

B 

0 

10 

19 

0.51 

0.23 

0.85 

-0.11 

30997 

C 

0 

16 

30 

0.59 

0.28 

1.08 

-0.10 

30997 

D 

0 

12 

23 

0.33 

0.25 

0.77 

-0.22 

30998 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

30998 

A 

1 

26 

46 

1.11 

0.14 

0.93 

0.35 

30998 

B 

0 

2 

4 

-0.42 

0.67 

0.36 

-0.27 

30998 

C 

0 

21 

38 

0.57 

0.18 

1.04 

-0.21 

30998 

D 

0 

7 

13 

0.62 

0.36 

1.27 

-0.08 

30999 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.05 

30999 

A 

1 

27 

48 

1.29 

0.19 

0.84 

0.54 

30999 

B 

0 

6 

11 

-0.95 

0.46 

0.33 

-0.41 

30999 

C 

0 

14 

25 

0.59 

0.28 

1.53 

0.01 

30999 

D 

0 

9 

16 

-0.58 

0.30 

0.38 

-0.40 

31000 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

31000 

A 

1 

13 

23 

1.20 

0.48 

2.71 

0.23 

31000 

B 

0 

27 

47 

0.56 

0.16 

0.88 

-0.14 

31000 

C 

0 

8 

14 

0.81 

0.32 

1.26 

0.03 

31000 

D 

0 

9 

16 

0.43 

0.32 

0.88 

-0.11 

31001 

* 

-1 

4943 

99 

1.21 

0.02 

0.00 

0.04 

31001 

A 

1 

49 

96 

0.78 

0.16 

1.01 

0.23 

31001 

B 

0 

1 

2 

-0.89 

0.00 

0.35 

-0.20 

31001 

C 

0 

1 

2 

-0.30 

0.00 

0.63 

-0.13 

31001 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

31002 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.05 

31002 

A 

1 

48 

87 

0.77 

0.14 

0.93 

0.45 

31002 

B 

0 

2 

4 

-0.22 

0.06 

0.67 

-0.14 

31002 

C 

0 

2 

4 

-0.28 

0.52 

0.72 

-0.15 

31002 

D 

0 

3 

5 

-1.33 

0.80 

0.35 

-0.42 

31003 

* 

-1 

4952 

99 

1.21 

0.02 

0.00 

0.03 

31003 

A 

1 

40 

95 

0.86 

0.15 

0.90 

0.31 

31003 

B 

0 

1 

2 

0.49 

0.00 

1.08 

-0.05 

31003 

C 

0 

1 

2 

-1.59 

0.00 

0.14 

-0.38 

31003 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31004 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.04 

31004 

A 

1 

45 

85 

0.88 

0.16 

0.87 

0.47 

31004 

B 

0 

3 

6 

-0.15 

0.08 

0.66 

-0.17 

31004 

C 

0 

3 

6 

-0.66 

0.21 

0.41 

-0.28 

31004 

D 

0 

2 

4 

-1.33 

1.56 

0.50 

-0.34 

31005 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.03 

31005 

A 

1 

56 

97 

0.95 

0.14 

0.64 

0.55 

31005 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31005 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31005 

D 

0 

2 

3 

-2.79 

1.39 

0.14 

-0.55 

31006 

* 

-1 

4956 

99 

1.21 

0.02 

0.00 

0.03 

31006 

A 

1 

32 

84 

1.13 

0.17 

0.89 

0.54 

31006 

B 

0 

1 

3 

-0.97 

0.00 

0.21 

-0.19 

31006 

C 

0 

4 

11 

0.07 

0.39 

0.69 

-0.16 

31006 

D 

0 

1 

3 

-5.89 

0.00 

0.00 

-0.73 

31007 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.04 

31007 

A 

1 

30 

55 

1.01 

0.19 

1.10 

0.32 

31007 

B 

0 

17 

31 

0.59 

0.18 

1.20 

-0.10 

31007 

C 

0 

4 

7 

0.54 

0.28 

0.96 

-0.06 

31007 

D 

0 

4 

7 

-0.58 

0.39 

0.35 

-0.38 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

31008 

* 

-1 

4947 

99 

1.21 

0.02 

0.00 

0.03 

31008 

A 

1 

41 

87 

0.99 

0.18 

0.92 

0.38 

31008 

B 

0 

3 

6 

0.72 

0.14 

1.51 

-0.02 

31008 

C 

0 

2 

4 

-0.91 

0.34 

0.31 

-0.29 

31008 

D 

0 

1 

2 

-2.89 

0.00 

0.04 

-0.43 

31009 

* 

-1 

4945 

99 

1.21 

0.02 

0.00 

0.02 

31009 

A 

1 

22 

45 

1.26 

0.31 

1.96 

0.19 

31009 

B 

0 

9 

18 

1.06 

0.31 

1.53 

0.02 

31009 

C 

0 

15 

31 

0.89 

0.24 

1.24 

-0.05 

31009 

D 

0 

3 

6 

-0.72 

1.09 

0.34 

-0.34 

31010 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.05 

31010 

A 

1 

47 

89 

0.75 

0.19 

0.88 

0.38 

31010 

B 

0 

4 

8 

-0.24 

0.32 

0.88 

-0.17 

31010 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31010 

D 

0 

2 

4 

-2.17 

0.73 

0.14 

-0.40 

31011 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

31011 

A 

1 

22 

39 

1.09 

0.25 

1.14 

0.30 

31011 

B 

0 

13 

23 

0.72 

0.19 

1.15 

0.02 

31011 

C 

0 

19 

34 

0.13 

0.24 

1.12 

-0.37 

31011 

D 

0 

2 

4 

1.28 

0.00 

1.69 

0.11 

31012 

* 

-1 

4955 

99 

1.21 

0.02 

0.00 

0.03 

31012 

A 

1 

37 

95 

0.81 

0.12 

0.84 

0.48 

31012 

B 

0 

2 

5 

-1.00 

0.95 

0.38 

-0.48 

31012 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31012 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31013 

* 

-1 

4949 

99 

1.21 

0.02 

0.00 

0.03 

31013 

A 

1 

41 

91 

0.98 

0.20 

0.95 

0.34 

31013 

B 

0 

2 

4 

-0.12 

0.92 

1.00 

-0.16 

31013 

C 

0 

1 

2 

-0.62 

0.00 

0.42 

-0.17 

31013 

D 

0 

1 

2 

-1.42 

0.00 

0.19 

-0.26 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

31014 

* 

-1 

4946 

99 

1.21 

0.02 

0.00 

0.04 

31014 

A 

1 

36 

75 

0.88 

0.14 

0.93 

0.31 

31014 

B 

0 

6 

13 

0.04 

0.67 

1.27 

-0.26 

31014 

C 

0 

3 

6 

0.27 

0.56 

1.08 

-0.12 

31014 

D 

0 

3 

6 

0.39 

0.55 

1.17 

-0.08 

31015 

* 

-1 

4952 

99 

1.21 

0.02 

0.00 

0.02 

31015 

A 

1 

41 

98 

0.94 

0.16 

0.98 

0.25 

31015 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31015 

C 

0 

1 

2 

-0.75 

0.00 

0.32 

-0.25 

31015 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31016 

* 

-1 

4946 

99 

1.21 

0.02 

0.00 

0.01 

31016 

A 

1 

37 

77 

1.31 

0.19 

1.09 

0.31 

31016 

B 

0 

2 

4 

0.14 

0.15 

0.50 

-0.19 

31016 

C 

0 

3 

6 

1.06 

0.79 

2.42 

-0.01 

31016 

D 

0 

6 

13 

0.35 

0.19 

0.68 

-0.27 

31017 

* 

-1 

4950 

99 

1.21 

0.02 

0.00 

0.02 

31017 

A 

1 

42 

95 

1.00 

0.14 

0.93 

0.36 

31017 

B 

0 

2 

5 

-0.65 

0.25 

0.31 

-0.36 

31017 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31017 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31018 

* 

-1 

4949 

99 

1.21 

0.02 

0.00 

0.00 

31018 

A 

1 

29 

64 

1.45 

0.23 

1.40 

0.27 

31018 

B 

0 

7 

16 

0.39 

0.27 

0.63 

-0.30 

31018 

C 

0 

8 

18 

1.20 

0.39 

1.88 

-0.01 

31018 

D 

0 

1 

2 

0.35 

0.00 

0.50 

-0.11 

31019 

* 

-1 

4958 

99 

1.21 

0.02 

0.00 

0.04 

31019 

A 

1 

32 

89 

0.78 

0.18 

0.92 

0.36 

31019 

B 

0 

4 

11 

-0.35 

0.21 

0.53 

-0.36 

31019 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31019 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

31020 

* 

-1 

4949 

99 

1.21 

0.02 

0.00 

0.04 

31020 

A 

1 

32 

71 

0.89 

0.18 

1.01 

0.35 

31020 

B 

0 

8 

18 

0.31 

0.26 

1.07 

-0.18 

31020 

C 

0 

5 

11 

-0.12 

0.26 

0.62 

-0.29 

31020 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31021 

* 

-1 

4944 

99 

1.21 

0.02 

0.00 

0.03 

31021 

A 

1 

44 

88 

0.92 

0.15 

0.97 

0.33 

31021 

B 

0 

5 

10 

-0.17 

0.54 

1.13 

-0.31 

31021 

C 

0 

1 

2 

-0.03 

0.00 

0.64 

-0.11 

31021 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31022 

* 

-1 

4949 

99 

1.21 

0.02 

0.00 

0.03 

31022 

A 

1 

42 

93 

0.94 

0.14 

0.86 

0.46 

31022 

B 

0 

1 

2 

-0.31 

0.00 

0.48 

-0.18 

31022 

C 

0 

2 

4 

-1.13 

0.50 

0.24 

-0.43 

31022 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31023 

* 

-1 

4956 

99 

1.21 

0.02 

0.00 

0.02 

31023 

A 

1 

8 

21 

1.77 

0.26 

0.70 

0.43 

31023 

B 

0 

6 

16 

1.04 

0.28 

1.00 

0.05 

31023 

C 

0 

21 

55 

0.74 

0.22 

1.03 

-0.20 

31023 

D 

0 

3 

8 

-0.30 

0.66 

0.31 

-0.35 

31024 

* 

-1 

4947 

99 

1.21 

0.02 

0.00 

0.04 

31024 

A 

1 

16 

34 

1.28 

0.22 

0.89 

0.49 

31024 

B 

0 

7 

15 

0.34 

0.18 

0.69 

-0.20 

31024 

C 

0 

16 

34 

0.51 

0.16 

0.91 

-0.18 

31024 

D 

0 

8 

17 

0.36 

0.27 

0.83 

-0.20 

31025 

* 

-1 

4951 

99 

1.21 

0.02 

0.00 

0.02 

31025 

A 

1 

21 

49 

1.19 

0.27 

1.27 

0.21 

31025 

B 

0 

3 

7 

1.11 

0.71 

1.80 

0.04 

31025 

C 

0 

11 

26 

0.88 

0.20 

1.27 

-0.05 

31025 

D 

0 

8 

19 

0.43 

0.32 

0.87 

-0.25 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

31026 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.05 

31026 

A 

1 

12 

21 

1.32 

0.43 

1.56 

0.27 

31026 

B 

0 

26 

46 

0.73 

0.19 

1.16 

0.07 

31026 

C 

0 

3 

5 

-0.08 

0.32 

0.37 

-0.13 

31026 

D 

0 

15 

27 

0.06 

0.41 

1.05 

-0.26 

31027 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

31027 

A 

1 

51 

89 

1.04 

0.15 

0.90 

0.41 

31027 

B 

0 

2 

4 

-1.01 

0.60 

0.29 

-0.31 

31027 

C 

0 

2 

4 

0.25 

1.15 

1.51 

-0.10 

31027 

D 

0 

2 

4 

-0.88 

0.03 

0.28 

-0.28 

31028 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.03 

31028 

A 

1 

41 

75 

1.10 

0.18 

0.87 

0.48 

31028 

B 

0 

10 

18 

-0.22 

0.21 

0.59 

-0.39 

31028 

C 

0 

2 

4 

-0.61 

0.48 

0.38 

-0.23 

31028 

D 

0 

2 

4 

0.24 

0.49 

0.89 

-0.09 

31029 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.05 

31029 

A 

1 

51 

89 

0.83 

0.16 

0.80 

0.48 

31029 

B 

0 

3 

5 

-1.49 

0.28 

0.23 

-0.39 

31029 

C 

0 

2 

4 

-0.31 

1.26 

1.31 

-0.14 

31029 

D 

0 

1 

2 

-1.95 

0.00 

0.13 

-0.27 

31030 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.05 

31030 

A 

1 

53 

93 

0.71 

0.14 

0.95 

0.30 

31030 

B 

0 

4 

7 

-0.59 

0.63 

0.81 

-0.30 

31030 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31030 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31031 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.04 

31031 

A 

1 

49 

89 

0.97 

0.16 

0.77 

0.50 

31031 

B 

0 

3 

5 

-0.97 

0.35 

0.33 

-0.33 

31031 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31031 

D 

0 

3 

5 

-1.14 

0.90 

0.43 

-0.36 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

31032 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.03 

31032 

A 

1 

52 

95 

0.86 

0.18 

1.27 

0.07 

31032 

B 

0 

2 

4 

1.01 

0.21 

2.20 

0.03 

31032 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31032 

D 

0 

1 

2 

-0.55 

0.00 

0.45 

-0.15 

31033 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.04 

31033 

A 

1 

51 

94 

0.87 

0.18 

0.93 

0.37 

31033 

B 

0 

1 

2 

-2.89 

0.00 

0.06 

-0.37 

31033 

C 

0 

2 

4 

-0.52 

0.29 

0.63 

-0.18 

31033 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31034 

* 

-1 

4944 

99 

1.21 

0.02 

0.00 

0.03 

31034 

A 

1 

44 

88 

0.88 

0.16 

1.09 

0.20 

31034 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31034 

C 

0 

5 

10 

0.47 

0.58 

2.00 

-0.10 

31034 

D 

0 

1 

2 

-0.97 

0.00 

0.26 

-0.24 

31035 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

31035 

A 

1 

37 

66 

1.16 

0.17 

1.02 

0.38 

31035 

B 

0 

14 

25 

0.47 

0.28 

1.24 

-0.20 

31035 

C 

0 

4 

7 

-0.38 

0.58 

0.55 

-0.31 

31035 

D 

0 

1 

2 

0.17 

0.00 

0.59 

-0.08 

31036 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

31036 

A 

1 

35 

63 

1.02 

0.19 

1.18 

0.31 

31036 

B 

0 

11 

20 

0.55 

0.27 

1.48 

-0.11 

31036 

C 

0 

1 

2 

0.15 

0.00 

0.61 

-0.08 

31036 

D 

0 

9 

16 

0.16 

0.21 

0.73 

-0.26 

31037 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.02 

31037 

A 

1 

47 

82 

1.15 

0.17 

0.93 

0.38 

31037 

B 

0 

2 

4 

-0.34 

1.28 

0.76 

-0.21 

31037 

C 

0 

3 

5 

0.31 

0.53 

0.95 

-0.13 

31037 

D 

0 

5 

9 

-0.08 

0.21 

0.56 

-0.27 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

31038 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.01 

31038 

A 

1 

42 

75 

1.22 

0.20 

1.13 

0.18 

31038 

B 

0 

7 

13 

0.99 

0.74 

5.72 

-0.02 

31038 

C 

0 

5 

9 

0.28 

0.57 

1.48 

-0.18 

31038 

D 

0 

2 

4 

0.22 

0.93 

0.94 

-0.12 

31039 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

31039 

A 

1 

56 

98 

0.94 

0.14 

0.91 

0.30 

31039 

B 

0 

1 

2 

-1.61 

0.00 

0.14 

-0.30 

31039 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31039 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31040 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.02 

31040 

A 

1 

37 

65 

1.34 

0.16 

0.86 

0.56 

31040 

B 

0 

4 

7 

0.03 

0.42 

0.61 

-0.22 

31040 

C 

0 

6 

11 

0.09 

0.37 

0.67 

-0.25 

31040 

D 

0 

10 

18 

0.07 

0.27 

0.72 

-0.35 

31041 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.01 

31041 

A 

1 

35 

63 

1.53 

0.20 

0.86 

0.55 

31041 

B 

0 

6 

11 

0.18 

0.38 

0.69 

-0.25 

31041 

C 

0 

7 

13 

0.30 

0.27 

0.72 

-0.23 

31041 

D 

0 

8 

14 

0.06 

0.14 

0.48 

-0.33 

31042 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.05 

31042 

A 

1 

39 

68 

0.85 

0.16 

1.09 

0.35 

31042 

B 

0 

7 

12 

0.46 

0.24 

1.21 

-0.06 

31042 

C 

0 

4 

7 

-0.04 

0.29 

0.67 

-0.19 

31042 

D 

0 

7 

12 

-0.10 

0.30 

0.69 

-0.28 

31043 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.03 

31043 

A 

1 

39 

67 

1.21 

0.17 

0.92 

0.48 

31043 

B 

0 

10 

17 

0.45 

0.26 

1.09 

-0.12 

31043 

C 

0 

2 

3 

-0.92 

0.43 

0.23 

-0.26 

31043 

D 

0 

7 

12 

-0.58 

0.60 

0.49 

-0.41 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

31044 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.04 

31044 

A 

1 

41 

77 

1.09 

0.18 

0.86 

0.52 

31044 

B 

0 

4 

8 

-0.16 

0.45 

0.74 

-0.15 

31044 

C 

0 

4 

8 

-0.63 

0.76 

0.59 

-0.23 

31044 

D 

0 

4 

8 

-1.75 

1.41 

0.53 

-0.44 

31045 

* 

-1 

4943 

99 

1.21 

0.02 

0.00 

0.05 

31045 

A 

1 

42 

82 

0.74 

0.15 

0.83 

0.49 

31045 

B 

0 

2 

4 

-1.04 

0.03 

0.30 

-0.28 

31045 

C 

0 

3 

6 

-1.05 

0.93 

0.52 

-0.35 

31045 

D 

0 

4 

8 

-0.17 

0.41 

0.89 

-0.18 

31046 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.03 

31046 

A 

1 

42 

72 

1.07 

0.14 

0.99 

0.43 

31046 

B 

0 

3 

5 

1.03 

0.41 

1.81 

0.05 

31046 

C 

0 

7 

12 

0.11 

0.21 

0.70 

-0.27 

31046 

D 

0 

6 

10 

-0.25 

0.24 

0.47 

-0.37 

31047 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.03 

31047 

A 

1 

36 

65 

1.31 

0.19 

0.84 

0.59 

31047 

B 

0 

4 

7 

-0.52 

0.31 

0.39 

-0.30 

31047 

C 

0 

3 

5 

-0.34 

0.54 

0.54 

-0.22 

31047 

D 

0 

12 

22 

-0.07 

0.18 

0.64 

-0.37 

31048 

* 

-1 

4703 

94 

1.17 

0.02 

0.00 

-0.10 

31048 

A 

1 

173 

59 

2.23 

0.09 

1.06 

0.42 

31048 

B 

0 

52 

18 

0.83 

0.11 

0.60 

-0.31 

31048 

C 

0 

55 

19 

1.63 

0.14 

2.00 

-0.04 

31048 

D 

0 

11 

4 

-0.77 

0.56 

0.21 

-0.37 

31049 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.02 

31049 

A 

1 

53 

91 

1.05 

0.15 

0.92 

0.37 

31049 

B 

0 

2 

3 

-0.35 

0.15 

0.45 

-0.21 

31049 

C 

0 

1 

2 

-1.44 

0.00 

0.15 

-0.27 

31049 

D 

0 

2 

3 

-0.14 

0.12 

0.55 

-0.17 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

31050 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.04 

31050 

A 

1 

17 

31 

1.59 

0.28 

0.99 

0.54 

31050 

B 

0 

12 

22 

0.40 

0.28 

0.92 

-0.11 

31050 

C 

0 

4 

7 

-0.14 

0.11 

0.38 

-0.19 

31050 

D 

0 

21 

39 

0.17 

0.23 

0.88 

-0.32 

31051 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.02 

31051 

A 

1 

33 

59 

1.27 

0.22 

1.10 

0.37 

31051 

B 

0 

3 

5 

-0.44 

0.37 

0.35 

-0.26 

31051 

C 

0 

14 

25 

0.52 

0.24 

1.16 

-0.18 

31051 

D 

0 

6 

11 

0.39 

0.36 

0.97 

-0.15 

31052 

* 

-1 

4932 

99 

1.21 

0.02 

0.00 

0.04 

31052 

A 

1 

30 

48 

1.44 

0.22 

1.87 

0.56 

31052 

B 

0 

8 

13 

0.14 

0.44 

1.03 

-0.19 

31052 

C 

0 

16 

26 

0.21 

0.16 

0.70 

-0.26 

31052 

D 

0 

8 

13 

-0.23 

0.16 

0.41 

-0.31 

31053 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.04 

31053 

A 

1 

18 

33 

1.37 

0.35 

1.58 

0.39 

31053 

B 

0 

22 

40 

0.67 

0.19 

1.17 

-0.01 

31053 

C 

0 

5 

9 

0.04 

0.40 

0.58 

-0.16 

31053 

D 

0 

10 

18 

-0.24 

0.32 

0.48 

-0.35 

31054 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.05 

31054 

A 

1 

13 

23 

0.85 

0.31 

1.74 

0.13 

31054 

B 

0 

17 

30 

0.82 

0.20 

1.34 

0.14 

31054 

C 

0 

18 

32 

0.48 

0.19 

0.96 

-0.04 

31054 

D 

0 

9 

16 

-0.22 

0.75 

0.90 

-0.27 

31055 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

31055 

A 

1 

15 

27 

1.39 

0.42 

1.52 

0.37 

31055 

B 

0 

17 

30 

0.79 

0.22 

1.30 

0.06 

31055 

C 

0 

12 

21 

0.35 

0.19 

0.74 

-0.15 

31055 

D 

0 

12 

21 

-0.02 

0.21 

0.52 

-0.32 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

31056 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

31056 

A 

1 

15 

27 

1.38 

0.26 

1.05 

0.36 

31056 

B 

0 

25 

45 

0.75 

0.14 

0.98 

-0.07 

31056 

C 

0 

6 

11 

0.27 

0.35 

0.63 

-0.21 

31056 

D 

0 

10 

18 

0.52 

0.35 

1.16 

-0.15 

31057 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

31057 

A 

1 

44 

79 

1.05 

0.16 

0.97 

0.44 

31057 

B 

0 

3 

5 

-0.28 

0.51 

0.53 

-0.18 

31057 

C 

0 

6 

11 

0.11 

0.24 

0.72 

-0.16 

31057 

D 

0 

3 

5 

-1.66 

2.12 

0.90 

-0.42 

31058 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.05 

31058 

A 

1 

35 

64 

1.12 

0.19 

0.79 

0.53 

31058 

B 

0 

4 

7 

-0.57 

0.79 

0.65 

-0.25 

31058 

C 

0 

12 

22 

-0.26 

0.26 

0.86 

-0.35 

31058 

D 

0 

4 

7 

-0.25 

0.65 

0.93 

-0.18 

31059 

* 

-1 

4932 

99 

1.21 

0.02 

0.00 

0.03 

31059 

A 

1 

55 

89 

0.89 

0.14 

1.09 

0.05 

31059 

B 

0 

5 

8 

0.57 

0.41 

1.56 

-0.09 

31059 

C 

0 

1 

2 

1.61 

0.00 

2.94 

0.09 

31059 

D 

0 

1 

2 

0.65 

0.00 

1.12 

-0.03 

31060 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

31060 

A 

1 

36 

63 

1.05 

0.19 

1.06 

0.31 

31060 

B 

0 

10 

18 

0.50 

0.35 

1.40 

-0.11 

31060 

C 

0 

9 

16 

0.35 

0.41 

1.33 

-0.16 

31060 

D 

0 

2 

4 

-0.96 

0.18 

0.21 

-0.28 

31061 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.03 

31061 

A 

1 

36 

68 

1.19 

0.18 

0.93 

0.37 

31061 

B 

0 

6 

11 

0.41 

0.51 

1.71 

-0.12 

31061 

C 

0 

8 

15 

0.67 

0.35 

1.63 

-0.06 

31061 

D 

0 

3 

6 

-1.70 

0.90 

0.22 

-0.49 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

31062 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.05 

31062 

A 

1 

38 

68 

1.00 

0.14 

0.84 

0.54 

31062 

B 

0 

12 

21 

0.16 

0.22 

0.93 

-0.25 

31062 

C 

0 

1 

2 

-0.66 

0.00 

0.32 

-0.17 

31062 

D 

0 

5 

9 

-0.80 

0.30 

0.32 

-0.45 

31063 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.01 

31063 

A 

1 

48 

86 

1.21 

0.15 

0.97 

0.38 

31063 

B 

0 

2 

4 

0.45 

0.42 

0.86 

-0.11 

31063 

C 

0 

2 

4 

-0.35 

0.36 

0.38 

-0.25 

31063 

D 

0 

4 

7 

0.08 

0.64 

1.11 

-0.25 

31064 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.05 

31064 

A 

1 

45 

79 

0.89 

0.15 

0.86 

0.48 

31064 

B 

0 

1 

2 

-0.78 

0.00 

0.33 

-0.18 

31064 

C 

0 

6 

11 

-0.40 

0.14 

0.50 

-0.33 

31064 

D 

0 

5 

9 

-0.26 

0.41 

0.79 

-0.26 

31065 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.05 

31065 

A 

1 

16 

30 

1.00 

0.32 

1.68 

0.27 

31065 

B 

0 

21 

40 

0.64 

0.15 

1.11 

0.06 

31065 

C 

0 

6 

11 

0.29 

0.43 

1.18 

-0.09 

31065 

D 

0 

10 

19 

-0.12 

0.37 

0.63 

-0.31 

31066 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.05 

31066 

A 

1 

21 

39 

1.14 

0.24 

1.27 

0.37 

31066 

B 

0 

16 

30 

0.70 

0.17 

1.13 

0.04 

31066 

C 

0 

8 

15 

-0.01 

0.29 

0.65 

-0.24 

31066 

D 

0 

9 

17 

-0.13 

0.47 

0.78 

-0.31 

31067 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.04 

31067 

A 

1 

16 

30 

0.97 

0.29 

2.18 

0.15 

31067 

B 

0 

19 

36 

0.74 

0.24 

1.34 

0.02 

31067 

C 

0 

13 

25 

0.54 

0.42 

1.32 

-0.08 

31067 

D 

0 

5 

9 

0.19 

0.46 

0.68 

-0.14 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

31068 

* 

-1 

4925 

99 

1.21 

0.02 

0.00 

0.01 

31068 

A 

1 

55 

80 

1.36 

0.14 

0.88 

0.39 

31068 

B 

0 

4 

6 

1.59 

0.36 

2.63 

0.10 

31068 

C 

0 

2 

3 

-0.52 

0.18 

0.27 

-0.26 

31068 

D 

0 

8 

12 

-0.15 

0.28 

0.50 

-0.43 

31069 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

31069 

A 

1 

41 

73 

0.93 

0.16 

0.93 

0.42 

31069 

B 

0 

3 

5 

0.05 

0.53 

0.87 

-0.13 

31069 

C 

0 

3 

5 

-0.55 

0.22 

0.40 

-0.26 

31069 

D 

0 

9 

16 

-0.01 

0.32 

0.95 

-0.27 

31070 

* 

-1 

4715 

94 

1.17 

0.02 

0.00 

-0.10 

31070 

A 

1 

211 

76 

2.05 

0.09 

0.97 

0.43 

31070 

B 

0 

28 

10 

1.12 

0.20 

1.43 

-0.15 

31070 

C 

0 

18 

6 

0.61 

0.23 

0.79 

-0.22 

31070 

D 

0 

22 

8 

0.35 

0.19 

0.51 

-0.30 

31071 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

31071 

A 

1 

17 

30 

1.64 

0.26 

0.88 

0.50 

31071 

B 

0 

9 

16 

0.94 

0.19 

1.07 

0.03 

31071 

C 

0 

7 

13 

0.64 

0.40 

1.18 

-0.08 

31071 

D 

0 

23 

41 

0.32 

0.17 

0.68 

-0.43 

31072 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.02 

31072 

A 

1 

12 

21 

1.19 

0.33 

1.73 

0.12 

31072 

B 

0 

10 

18 

1.09 

0.28 

1.18 

0.06 

31072 

C 

0 

8 

14 

1.42 

0.41 

2.08 

0.19 

31072 

D 

0 

27 

47 

0.67 

0.17 

0.83 

-0.28 

31073 

* 

-1 

4920 

99 

1.21 

0.02 

0.00 

0.00 

31073 

A 

1 

25 

34 

1.58 

0.21 

1.29 

0.27 

31073 

B 

0 

16 

22 

0.97 

0.18 

0.91 

-0.11 

31073 

C 

0 

14 

19 

0.92 

0.21 

0.88 

-0.12 

31073 

D 

0 

19 

26 

1.05 

0.31 

1.62 

-0.08 

easyCBM  CCSS  Third  Grade  Math  Measure  Development 


405 

Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

31074 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.03 

31074 

A 

1 

39 

72 

1.14 

0.20 

1.00 

0.45 

31074 

B 

0 

1 

2 

-0.61 

0.00 

0.34 

-0.16 

31074 

C 

0 

12 

22 

-0.13 

0.18 

0.64 

-0.40 

31074 

D 

0 

2 

4 

0.24 

0.20 

0.81 

-0.09 

31075 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

31075 

A 

1 

38 

67 

1.05 

0.20 

1.51 

0.18 

31075 

B 

0 

18 

32 

0.44 

0.23 

1.15 

-0.26 

31075 

C 

0 

1 

2 

3.18 

0.00 

11.97 

0.25 

31075 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31076 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

31076 

A 

1 

33 

59 

1.02 

0.18 

1.05 

0.31 

31076 

B 

0 

1 

2 

0.52 

0.00 

0.86 

-0.04 

31076 

C 

0 

2 

4 

0.73 

0.80 

1.41 

-0.01 

31076 

D 

0 

20 

36 

0.38 

0.19 

1.10 

-0.30 

31077 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

31077 

A 

1 

37 

66 

0.97 

0.17 

1.18 

0.40 

31077 

B 

0 

7 

13 

0.15 

0.31 

1.02 

-0.19 

31077 

C 

0 

2 

4 

-0.83 

0.05 

0.26 

-0.28 

31077 

D 

0 

10 

18 

0.23 

0.25 

0.98 

-0.20 

31078 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.02 

31078 

A 

1 

21 

36 

1.64 

0.12 

0.67 

0.58 

31078 

B 

0 

11 

19 

0.93 

0.15 

0.94 

-0.03 

31078 

C 

0 

3 

5 

0.94 

0.27 

0.92 

-0.01 

31078 

D 

0 

23 

40 

0.42 

0.18 

0.70 

-0.54 

31079 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.05 

31079 

A 

1 

22 

42 

1.04 

0.24 

1.20 

0.37 

31079 

B 

0 

3 

6 

0.07 

0.10 

0.58 

-0.09 

31079 

C 

0 

7 

13 

0.30 

0.35 

1.13 

-0.07 

31079 

D 

0 

21 

40 

0.11 

0.27 

0.95 

-0.28 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

31080 

* 

-1 

4930 

99 

1.21 

0.02 

0.00 

0.03 

31080 

A 

1 

21 

33 

1.44 

0.25 

1.64 

0.37 

31080 

B 

0 

11 

17 

0.69 

0.17 

0.80 

-0.08 

31080 

C 

0 

11 

17 

0.60 

0.37 

1.20 

-0.12 

31080 

D 

0 

21 

33 

0.56 

0.22 

0.90 

-0.21 

31081 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.02 

31081 

A 

1 

17 

29 

1.51 

0.26 

1.01 

0.32 

31081 

B 

0 

10 

17 

0.85 

0.27 

1.10 

-0.04 

31081 

C 

0 

10 

17 

0.87 

0.48 

2.05 

-0.03 

31081 

D 

0 

22 

37 

0.61 

0.19 

0.81 

-0.24 

31082 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.02 

31082 

A 

1 

40 

74 

1.06 

0.16 

1.45 

0.11 

31082 

B 

0 

13 

24 

0.73 

0.17 

1.09 

-0.16 

31082 

C 

0 

1 

2 

2.00 

0.00 

3.26 

0.15 

31082 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31083 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.02 

31083 

A 

1 

31 

54 

1.10 

0.16 

1.41 

0.23 

31083 

B 

0 

25 

44 

0.69 

0.19 

1.32 

-0.19 

31083 

C 

0 

1 

2 

-0.37 

0.00 

0.29 

-0.18 

31083 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31084 

* 

-1 

4948 

99 

1.21 

0.02 

0.00 

0.03 

31084 

A 

1 

27 

59 

1.24 

0.25 

1.05 

0.40 

31084 

B 

0 

12 

26 

0.66 

0.15 

1.11 

-0.08 

31084 

C 

0 

5 

11 

-0.02 

0.23 

0.57 

-0.24 

31084 

D 

0 

2 

4 

-1.62 

0.02 

0.10 

-0.43 

31085 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.02 

31085 

A 

1 

31 

53 

1.51 

0.16 

0.77 

0.60 

31085 

B 

0 

2 

3 

0.59 

0.46 

0.81 

-0.07 

31085 

C 

0 

12 

21 

0.28 

0.16 

0.61 

-0.35 

31085 

D 

0 

13 

22 

0.32 

0.21 

0.70 

-0.35 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

31086 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.03 

31086 

A 

1 

50 

83 

0.96 

0.15 

1.07 

0.35 

31086 

B 

0 

5 

8 

0.02 

0.26 

0.71 

-0.23 

31086 

C 

0 

1 

2 

-0.02 

0.00 

0.61 

-0.10 

31086 

D 

0 

4 

7 

-0.01 

0.35 

0.72 

-0.21 

31087 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.01 

31087 

A 

1 

39 

70 

1.44 

0.16 

0.86 

0.53 

31087 

B 

0 

8 

14 

-0.12 

0.21 

0.44 

-0.46 

31087 

C 

0 

1 

2 

1.60 

0.00 

2.08 

0.07 

31087 

D 

0 

8 

14 

0.38 

0.28 

0.79 

-0.26 

31088 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

31088 

A 

1 

49 

88 

0.95 

0.15 

1.02 

0.32 

31088 

B 

0 

4 

7 

0.14 

0.28 

0.82 

-0.17 

31088 

C 

0 

2 

4 

-0.06 

0.49 

0.67 

-0.16 

31088 

D 

0 

1 

2 

-1.13 

0.00 

0.21 

-0.24 

31089 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

31089 

A 

1 

34 

60 

1.26 

0.19 

1.08 

0.41 

31089 

B 

0 

6 

11 

1.07 

0.35 

1.80 

0.06 

31089 

C 

0 

8 

14 

0.02 

0.28 

0.63 

-0.32 

31089 

D 

0 

9 

16 

0.12 

0.21 

0.61 

-0.30 

31090 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.01 

31090 

A 

1 

46 

84 

1.33 

0.12 

0.77 

0.61 

31090 

B 

0 

2 

4 

-0.26 

0.04 

0.36 

-0.26 

31090 

C 

0 

2 

4 

-0.21 

0.97 

0.57 

-0.25 

31090 

D 

0 

5 

9 

-0.37 

0.37 

0.41 

-0.45 

31091 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.03 

31091 

A 

1 

27 

51 

1.44 

0.18 

0.83 

0.61 

31091 

B 

0 

5 

9 

0.37 

0.22 

0.70 

-0.14 

31091 

C 

0 

7 

13 

0.58 

0.34 

1.08 

-0.09 

31091 

D 

0 

14 

26 

-0.11 

0.18 

0.50 

-0.53 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

31092 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.02 

31092 

A 

1 

46 

81 

1.18 

0.18 

0.96 

0.44 

31092 

B 

0 

1 

2 

-0.01 

0.00 

0.59 

-0.10 

31092 

C 

0 

2 

4 

0.17 

0.34 

0.75 

-0.11 

31092 

D 

0 

8 

14 

-0.31 

0.14 

0.47 

-0.40 

31093 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.03 

31093 

A 

1 

28 

52 

1.39 

0.27 

0.96 

0.50 

31093 

B 

0 

8 

15 

0.55 

0.26 

1.21 

-0.07 

31093 

C 

0 

5 

9 

0.20 

0.36 

0.88 

-0.14 

31093 

D 

0 

13 

24 

-0.25 

0.16 

0.49 

-0.43 

31094 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

31094 

A 

1 

43 

77 

1.00 

0.14 

0.86 

0.49 

31094 

B 

0 

1 

2 

-0.35 

0.00 

0.45 

-0.13 

31094 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31094 

D 

0 

12 

21 

-0.26 

0.29 

0.74 

-0.47 

31095 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.02 

31095 

A 

1 

38 

67 

1.29 

0.17 

0.87 

0.51 

31095 

B 

0 

4 

7 

0.62 

0.16 

0.95 

-0.07 

31095 

C 

0 

6 

11 

0.38 

0.28 

0.85 

-0.17 

31095 

D 

0 

9 

16 

-0.27 

0.25 

0.47 

-0.47 

31096 

* 

-1 

4696 

94 

1.17 

0.02 

0.00 

-0.12 

31096 

A 

1 

283 

95 

1.92 

0.08 

0.97 

0.30 

31096 

B 

0 

8 

3 

0.19 

0.28 

0.52 

-0.20 

31096 

C 

0 

3 

1 

0.09 

0.23 

0.36 

-0.13 

31096 

D 

0 

4 

1 

-0.16 

0.41 

0.34 

-0.18 

31097 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

31097 

A 

1 

28 

50 

1.68 

0.25 

0.85 

0.60 

31097 

B 

0 

1 

2 

-0.69 

0.00 

0.24 

-0.15 

31097 

C 

0 

15 

27 

0.28 

0.27 

1.01 

-0.25 

31097 

D 

0 

12 

21 

-0.22 

0.15 

0.42 

-0.41 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

31098 

* 

-1 

4711 

94 

1.18 

0.02 

0.00 

-0.09 

31098 

A 

1 

261 

92 

1.81 

0.07 

0.96 

0.39 

31098 

B 

0 

7 

2 

0.31 

0.35 

0.59 

-0.19 

31098 

C 

0 

7 

2 

0.24 

0.24 

0.48 

-0.20 

31098 

D 

0 

8 

3 

-0.18 

0.22 

0.33 

-0.27 

31099 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.05 

31099 

A 

1 

27 

50 

1.14 

0.19 

0.75 

0.54 

31099 

B 

0 

5 

9 

0.04 

0.45 

1.05 

-0.13 

31099 

C 

0 

11 

20 

-0.17 

0.37 

1.02 

-0.29 

31099 

D 

0 

11 

20 

-0.15 

0.28 

0.85 

-0.29 

31100 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.04 

31100 

A 

1 

42 

76 

0.83 

0.20 

1.25 

0.18 

31100 

B 

0 

2 

4 

1.65 

1.03 

5.67 

0.15 

31100 

C 

0 

3 

5 

-0.14 

0.40 

0.70 

-0.17 

31100 

D 

0 

8 

15 

0.14 

0.21 

0.91 

-0.19 

31151 

* 

-1 

4954 

99 

1.21 

0.02 

0.00 

0.02 

31151 

A 

1 

33 

83 

0.92 

0.18 

1.25 

0.08 

31151 

B 

0 

6 

15 

1.04 

0.36 

2.39 

0.06 

31151 

C 

0 

1 

3 

-1.25 

0.00 

0.16 

-0.33 

31151 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31152 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.04 

31152 

A 

1 

45 

83 

0.93 

0.19 

0.98 

0.31 

31152 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31152 

C 

0 

7 

13 

-0.06 

0.47 

1.12 

-0.25 

31152 

D 

0 

2 

4 

-0.42 

0.14 

0.49 

-0.18 

31153 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.05 

31153 

A 

1 

20 

35 

1.16 

0.22 

0.96 

0.39 

31153 

B 

0 

19 

33 

0.53 

0.20 

1.14 

-0.07 

31153 

C 

0 

9 

16 

0.22 

0.35 

0.93 

-0.17 

31153 

D 

0 

9 

16 

0.03 

0.27 

0.66 

-0.25 

easyCBM  CCSS  Third  Grade  Math  Measure  Development 


410 

Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

31154 

* 

-1 

4929 

99 

1.21 

0.02 

0.00 

0.02 

31154 

A 

1 

30 

46 

1.41 

0.20 

0.91 

0.38 

31154 

B 

0 

18 

28 

1.00 

0.24 

1.79 

0.03 

31154 

C 

0 

10 

15 

0.09 

0.28 

0.57 

-0.33 

31154 

D 

0 

7 

11 

0.11 

0.27 

0.55 

-0.26 

31155 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.03 

31155 

A 

1 

42 

71 

1.10 

0.13 

0.82 

0.48 

31155 

B 

0 

11 

19 

0.36 

0.34 

1.32 

-0.20 

31155 

C 

0 

4 

7 

-0.58 

0.46 

0.38 

-0.36 

31155 

D 

0 

2 

3 

-0.70 

0.45 

0.30 

-0.27 

31156 

* 

-1 

4948 

99 

1.21 

0.02 

0.00 

0.03 

31156 

A 

1 

35 

76 

0.91 

0.15 

0.96 

0.32 

31156 

B 

0 

8 

17 

0.52 

0.43 

1.99 

-0.09 

31156 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31156 

D 

0 

3 

7 

-0.85 

0.53 

0.35 

-0.41 

31157 

* 

-1 

4951 

99 

1.21 

0.02 

0.00 

0.03 

31157 

A 

1 

33 

77 

1.01 

0.19 

1.02 

0.38 

31157 

B 

0 

7 

16 

0.31 

0.24 

1.02 

-0.18 

31157 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31157 

D 

0 

3 

7 

-0.71 

0.44 

0.37 

-0.37 

31158 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.03 

31158 

A 

1 

52 

96 

0.98 

0.19 

0.67 

0.42 

31158 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31158 

C 

0 

1 

2 

-0.44 

0.00 

0.79 

-0.12 

31158 

D 

0 

1 

2 

-4.46 

0.00 

0.01 

-0.48 

31159 

* 

-1 

4959 

99 

1.21 

0.02 

0.00 

0.03 

31159 

A 

1 

32 

91 

0.80 

0.20 

0.92 

0.26 

31159 

B 

0 

2 

6 

-0.13 

2.26 

3.77 

-0.17 

31159 

C 

0 

1 

3 

-0.70 

0.00 

0.44 

-0.20 

31159 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

31160 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.03 

31160 

A 

1 

55 

92 

0.85 

0.16 

1.07 

0.18 

31160 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31160 

C 

0 

5 

8 

0.10 

0.18 

0.86 

-0.18 

31160 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31161 

* 

-1 

4928 

99 

1.21 

0.02 

0.00 

0.00 

31161 

A 

1 

29 

44 

1.66 

0.16 

0.92 

0.42 

31161 

B 

0 

19 

29 

0.99 

0.21 

1.17 

-0.13 

31161 

C 

0 

11 

17 

1.06 

0.30 

1.16 

-0.06 

31161 

D 

0 

7 

11 

-0.03 

0.29 

0.35 

-0.42 

31162 

* 

-1 

4953 

99 

1.21 

0.02 

0.00 

0.02 

31162 

A 

1 

38 

93 

1.12 

0.19 

0.53 

0.65 

31162 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31162 

C 

0 

1 

2 

-1.62 

0.00 

0.20 

-0.26 

31162 

D 

0 

2 

5 

-3.16 

1.03 

0.07 

-0.60 

31163 

* 

-1 

4945 

99 

1.21 

0.02 

0.00 

0.02 

31163 

A 

1 

38 

78 

1.07 

0.13 

0.93 

0.41 

31163 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31163 

C 

0 

10 

20 

0.26 

0.24 

0.83 

-0.37 

31163 

D 

0 

1 

2 

0.07 

0.00 

0.53 

-0.14 

31164 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.06 

31164 

A 

1 

31 

54 

1.03 

0.16 

0.95 

0.49 

31164 

B 

0 

4 

7 

-0.50 

0.72 

0.74 

-0.22 

31164 

C 

0 

8 

14 

-0.40 

0.23 

0.49 

-0.29 

31164 

D 

0 

14 

25 

0.02 

0.42 

1.36 

-0.21 

31165 

* 

-1 

4931 

99 

1.21 

0.02 

0.00 

0.05 

31165 

A 

1 

35 

56 

1.05 

0.16 

0.92 

0.53 

31165 

B 

0 

2 

3 

0.37 

0.30 

0.89 

-0.04 

31165 

C 

0 

6 

10 

0.02 

0.19 

0.65 

-0.17 

31165 

D 

0 

20 

32 

-0.09 

0.21 

0.75 

-0.44 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

31166 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.05 

31166 

A 

1 

9 

17 

1.25 

0.28 

0.92 

0.31 

31166 

B 

0 

18 

33 

0.55 

0.25 

1.14 

0.01 

31166 

C 

0 

8 

15 

0.57 

0.27 

0.93 

0.01 

31166 

D 

0 

19 

35 

0.16 

0.26 

0.87 

-0.26 

31167 

* 

-1 

4939 

99 

1.21 

0.02 

0.00 

0.04 

31167 

A 

1 

38 

69 

1.09 

0.18 

0.90 

0.51 

31167 

B 

0 

4 

7 

-0.42 

0.35 

0.50 

-0.26 

31167 

C 

0 

4 

7 

-0.46 

0.69 

0.74 

-0.27 

31167 

D 

0 

9 

16 

-0.06 

0.29 

0.91 

-0.27 

31168 

* 

-1 

4925 

99 

1.21 

0.02 

0.00 

0.04 

31168 

A 

1 

55 

80 

1.03 

0.14 

0.93 

0.41 

31168 

B 

0 

4 

6 

-0.17 

0.33 

0.60 

-0.23 

31168 

C 

0 

5 

7 

-0.31 

0.45 

0.57 

-0.29 

31168 

D 

0 

5 

7 

0.24 

0.43 

1.10 

-0.15 

31169 

* 

-1 

4946 

99 

1.21 

0.02 

0.00 

0.04 

31169 

A 

1 

31 

65 

1.14 

0.16 

0.79 

0.53 

31169 

B 

0 

1 

2 

0.60 

0.00 

1.06 

0.00 

31169 

C 

0 

2 

4 

1.74 

0.17 

3.35 

0.18 

31169 

D 

0 

14 

29 

-0.62 

0.35 

0.52 

-0.63 

31170 

* 

-1 

4928 

99 

1.21 

0.02 

0.00 

0.04 

31170 

A 

1 

28 

42 

1.12 

0.19 

1.00 

0.34 

31170 

B 

0 

16 

24 

0.29 

0.29 

1.11 

-0.21 

31170 

C 

0 

11 

17 

0.42 

0.31 

1.12 

-0.11 

31170 

D 

0 

11 

17 

0.44 

0.29 

1.15 

-0.11 

31171 

* 

-1 

4930 

99 

1.21 

0.02 

0.00 

0.05 

31171 

A 

1 

12 

19 

1.55 

0.49 

1.11 

0.36 

31171 

B 

0 

19 

30 

0.46 

0.26 

1.21 

-0.08 

31171 

C 

0 

9 

14 

0.11 

0.44 

0.87 

-0.16 

31171 

D 

0 

24 

38 

0.45 

0.17 

0.88 

-0.10 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

31172 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

31172 

A 

1 

43 

75 

0.93 

0.14 

0.91 

0.45 

31172 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31172 

C 

0 

3 

5 

-0.01 

0.47 

0.77 

-0.16 

31172 

D 

0 

11 

19 

-0.13 

0.24 

0.79 

-0.40 

31173 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.05 

31173 

A 

1 

17 

31 

1.36 

0.22 

0.86 

0.42 

31173 

B 

0 

6 

11 

-0.13 

0.28 

0.46 

-0.20 

31173 

C 

0 

22 

41 

0.53 

0.23 

1.11 

-0.02 

31173 

D 

0 

9 

17 

-0.35 

0.58 

0.77 

-0.33 

31174 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.03 

31174 

A 

1 

39 

65 

1.26 

0.18 

0.91 

0.50 

31174 

B 

0 

6 

10 

-0.05 

0.39 

0.70 

-0.23 

31174 

C 

0 

5 

8 

-0.11 

0.45 

0.67 

-0.22 

31174 

D 

0 

10 

17 

0.04 

0.34 

0.89 

-0.28 

31175 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.01 

31175 

A 

1 

32 

60 

1.49 

0.22 

0.97 

0.36 

31175 

B 

0 

4 

8 

0.25 

0.93 

1.24 

-0.20 

31175 

C 

0 

7 

13 

0.96 

0.44 

1.87 

-0.05 

31175 

D 

0 

10 

19 

0.39 

0.27 

0.78 

-0.28 

31176 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.05 

31176 

A 

1 

39 

68 

1.04 

0.20 

1.03 

0.52 

31176 

B 

0 

2 

4 

-0.82 

0.41 

0.35 

-0.19 

31176 

C 

0 

3 

5 

-0.07 

0.10 

0.69 

-0.11 

31176 

D 

0 

13 

23 

-0.54 

0.32 

0.62 

-0.43 

31177 

* 

-1 

4941 

99 

1.21 

0.02 

0.00 

0.04 

31177 

A 

1 

42 

79 

0.95 

0.17 

0.88 

0.46 

31177 

B 

0 

2 

4 

-0.80 

1.42 

0.70 

-0.22 

31177 

C 

0 

6 

11 

0.06 

0.25 

0.87 

-0.16 

31177 

D 

0 

3 

6 

-1.58 

1.47 

0.47 

-0.41 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

31178 

* 

-1 

4936 

99 

1.21 

0.02 

0.00 

0.01 

31178 

A 

1 

40 

69 

1.36 

0.22 

1.32 

0.35 

31178 

B 

0 

8 

14 

0.80 

0.44 

1.91 

-0.07 

31178 

C 

0 

3 

5 

0.19 

1.10 

1.79 

-0.14 

31178 

D 

0 

7 

12 

-0.23 

0.21 

0.44 

-0.34 

31179 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

31179 

A 

1 

51 

91 

0.98 

0.16 

0.89 

0.41 

31179 

B 

0 

1 

2 

-0.84 

0.00 

0.29 

-0.19 

31179 

C 

0 

3 

5 

-0.67 

0.21 

0.36 

-0.31 

31179 

D 

0 

1 

2 

-0.62 

0.00 

0.36 

-0.17 

31180 

* 

-1 

4956 

99 

1.21 

0.02 

0.00 

0.03 

31180 

A 

1 

33 

87 

1.04 

0.23 

1.44 

0.42 

31180 

B 

0 

3 

8 

0.47 

0.63 

1.43 

-0.05 

31180 

C 

0 

1 

3 

-0.75 

0.00 

0.31 

-0.15 

31180 

D 

0 

1 

3 

-5.70 

0.00 

0.00 

-0.65 

31181 

* 

-1 

4946 

99 

1.21 

0.02 

0.00 

0.03 

31181 

A 

1 

45 

94 

0.96 

0.15 

0.80 

0.36 

31181 

B 

0 

2 

4 

0.77 

0.51 

2.06 

-0.01 

31181 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31181 

D 

0 

1 

2 

-4.19 

0.00 

0.01 

-0.59 

31182 

* 

-1 

4951 

99 

1.21 

0.02 

0.00 

0.02 

31182 

A 

1 

39 

91 

1.04 

0.21 

0.94 

0.33 

31182 

B 

0 

1 

2 

-0.92 

0.00 

0.31 

-0.20 

31182 

C 

0 

2 

5 

-0.39 

1.50 

1.23 

-0.21 

31182 

D 

0 

1 

2 

-0.37 

0.00 

0.53 

-0.14 

31183 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.04 

31183 

A 

1 

37 

69 

1.02 

0.14 

0.81 

0.50 

31183 

B 

0 

7 

13 

0.19 

0.62 

2.62 

-0.16 

31183 

C 

0 

9 

17 

-0.41 

0.26 

0.52 

-0.43 

31183 

D 

0 

1 

2 

-0.33 

0.00 

0.45 

-0.12 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

31184 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

31184 

A 

1 

40 

71 

1.02 

0.22 

1.65 

0.25 

31184 

B 

0 

6 

11 

0.36 

0.54 

1.40 

-0.12 

31184 

C 

0 

4 

7 

0.17 

0.59 

1.23 

-0.14 

31184 

D 

0 

6 

11 

0.30 

0.39 

1.13 

-0.13 

31185 

* 

-1 

4949 

99 

1.21 

0.02 

0.00 

0.04 

31185 

A 

1 

40 

89 

0.90 

0.19 

0.85 

0.43 

31185 

B 

0 

2 

4 

-0.23 

0.87 

0.95 

-0.15 

31185 

C 

0 

1 

2 

-1.36 

0.00 

0.22 

-0.24 

31185 

D 

0 

2 

4 

-1.35 

0.94 

0.32 

-0.34 

31186 

* 

-1 

4957 

99 

1.21 

0.02 

0.00 

0.03 

31186 

A 

1 

36 

97 

0.80 

0.19 

1.00 

0.17 

31186 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31186 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31186 

D 

0 

1 

3 

-0.33 

0.00 

0.55 

-0.17 

31187 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.04 

31187 

A 

1 

52 

96 

0.74 

0.14 

0.82 

0.46 

31187 

B 

0 

1 

2 

-2.23 

0.00 

0.10 

-0.36 

31187 

C 

0 

1 

2 

-1.59 

0.00 

0.18 

-0.28 

31187 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31188 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

31188 

A 

1 

54 

96 

0.79 

0.13 

0.98 

0.38 

31188 

B 

0 

1 

2 

-1.07 

0.00 

0.27 

-0.25 

31188 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31188 

D 

0 

1 

2 

-1.42 

0.00 

0.19 

-0.29 

31189 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.02 

31189 

A 

1 

31 

52 

1.39 

0.18 

1.13 

0.40 

31189 

B 

0 

11 

18 

0.85 

0.33 

1.44 

-0.07 

31189 

C 

0 

2 

3 

1.40 

0.34 

1.61 

0.07 

31189 

D 

0 

16 

27 

0.29 

0.15 

0.65 

-0.42 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

31190 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

31190 

A 

1 

20 

35 

1.36 

0.31 

1.55 

0.35 

31190 

B 

0 

15 

26 

0.76 

0.25 

1.30 

0.01 

31190 

C 

0 

7 

12 

0.43 

0.61 

1.49 

-0.09 

31190 

D 

0 

15 

26 

0.06 

0.22 

0.58 

-0.32 

31191 

* 

-1 

4940 

99 

1.21 

0.02 

0.00 

0.02 

31191 

A 

1 

26 

48 

1.46 

0.21 

0.90 

0.49 

31191 

B 

0 

5 

9 

0.76 

0.23 

0.97 

-0.04 

31191 

C 

0 

15 

28 

0.30 

0.29 

0.90 

-0.32 

31191 

D 

0 

8 

15 

0.19 

0.28 

0.65 

-0.26 

31192 

* 

-1 

4935 

99 

1.21 

0.02 

0.00 

0.06 

31192 

A 

1 

37 

63 

0.86 

0.14 

0.85 

0.41 

31192 

B 

0 

9 

15 

-0.18 

0.56 

1.17 

-0.26 

31192 

C 

0 

6 

10 

-0.12 

0.33 

0.77 

-0.19 

31192 

D 

0 

7 

12 

0.02 

0.50 

1.16 

-0.16 

31193 

* 

-1 

4949 

99 

1.21 

0.02 

0.00 

0.01 

31193 

A 

1 

43 

96 

1.16 

0.15 

0.77 

0.53 

31193 

B 

0 

2 

4 

-1.66 

0.22 

0.12 

-0.53 

31193 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31193 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31194 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.03 

31194 

A 

1 

26 

46 

1.39 

0.20 

0.92 

0.47 

31194 

B 

0 

7 

13 

-0.62 

0.41 

0.38 

-0.45 

31194 

C 

0 

8 

14 

0.91 

0.48 

3.06 

0.04 

31194 

D 

0 

15 

27 

0.34 

0.17 

0.78 

-0.23 

31195 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.06 

31195 

A 

1 

35 

63 

0.91 

0.18 

0.95 

0.46 

31195 

B 

0 

9 

16 

0.39 

0.23 

1.25 

-0.03 

31195 

C 

0 

1 

2 

0.48 

0.00 

1.11 

0.00 

31195 

D 

0 

11 

20 

-0.83 

0.39 

0.48 

-0.53 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

31196 

* 

-1 

4947 

99 

1.21 

0.02 

0.00 

0.03 

31196 

A 

1 

43 

91 

0.82 

0.19 

1.05 

0.12 

31196 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31196 

C 

0 

1 

2 

0.04 

0.00 

0.73 

-0.09 

31196 

D 

0 

3 

6 

0.38 

0.30 

1.12 

-0.09 

31197 

* 

-1 

4958 

99 

1.21 

0.02 

0.00 

0.02 

31197 

A 

1 

18 

50 

0.93 

0.22 

1.43 

0.10 

31197 

B 

0 

14 

39 

0.82 

0.28 

1.49 

-0.02 

31197 

C 

0 

4 

11 

0.49 

0.55 

0.94 

-0.13 

31197 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31198 

* 

-1 

4948 

99 

1.21 

0.02 

0.00 

0.03 

31198 

A 

1 

45 

98 

0.77 

0.16 

1.02 

0.23 

31198 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31198 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31198 

D 

0 

1 

2 

-0.91 

0.00 

0.35 

-0.23 

31200 

* 

-1 

4951 

99 

1.21 

0.02 

0.00 

0.02 

31200 

A 

1 

41 

95 

1.01 

0.19 

1.06 

0.32 

31200 

B 

0 

2 

5 

-0.83 

0.01 

0.35 

-0.32 

31200 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31200 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31201 

* 

-1 

4958 

99 

1.21 

0.02 

0.00 

0.02 

31201 

A 

1 

34 

94 

0.99 

0.19 

0.87 

0.43 

31201 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31201 

C 

0 

1 

3 

-0.73 

0.00 

0.36 

-0.23 

31201 

D 

0 

1 

3 

-1.67 

0.00 

0.14 

-0.37 

31202 

* 

-1 

4953 

99 

1.21 

0.02 

0.00 

0.02 

31202 

A 

1 

40 

98 

0.95 

0.17 

1.04 

-0.15 

31202 

B 

0 

1 

2 

1.95 

0.00 

4.18 

0.15 

31202 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31202 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

31203 

* 

-1 

4954 

99 

1.21 

0.02 

0.00 

0.04 

31203 

A 

-1 

40 

100 

0.66 

0.20 

0.00 

0.00 

31203 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

31203 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

31203 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

31204 

* 

-1 

4934 

99 

1.21 

0.02 

0.00 

0.05 

31204 

A 

1 

41 

68 

0.97 

0.20 

1.02 

0.39 

31204 

B 

0 

3 

5 

0.51 

0.31 

1.37 

-0.02 

31204 

C 

0 

14 

23 

-0.24 

0.29 

1.30 

-0.36 

31204 

D 

0 

2 

3 

-0.50 

1.23 

0.84 

-0.16 

31205 

* 

-1 

4950 

99 

1.21 

0.02 

0.00 

0.03 

31205 

A 

1 

28 

64 

1.19 

0.18 

0.89 

0.48 

31205 

B 

0 

15 

34 

0.17 

0.23 

0.90 

-0.45 

31205 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31205 

D 

0 

1 

2 

-0.07 

0.00 

0.48 

-0.13 

31206 

* 

-1 

4949 

99 

1.21 

0.02 

0.00 

0.03 

31206 

A 

-1 

45 

100 

0.80 

0.16 

0.00 

0.00 

31206 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

31206 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

31206 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

31208 

* 

-1 

4954 

99 

1.21 

0.02 

0.00 

0.03 

31208 

A 

1 

30 

75 

0.97 

0.22 

1.00 

0.38 

31208 

B 

0 

9 

23 

0.07 

0.20 

0.81 

-0.30 

31208 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31208 

D 

0 

1 

3 

-1.07 

0.00 

0.22 

-0.25 

31209 

* 

-1 

4957 

99 

1.21 

0.02 

0.00 

0.03 

31209 

A 

1 

18 

49 

0.93 

0.18 

1.02 

0.24 

31209 

B 

0 

19 

51 

0.51 

0.22 

1.24 

-0.24 

31209 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31209 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

31210 

* 

-1 

4951 

99 

1.21 

0.02 

0.00 

0.02 

31210 

A 

1 

39 

91 

1.08 

0.15 

0.86 

0.51 

31210 

B 

0 

2 

5 

-1.28 

0.58 

0.21 

-0.45 

31210 

C 

0 

1 

2 

-0.51 

0.00 

0.39 

-0.20 

31210 

D 

0 

1 

2 

-0.22 

0.00 

0.52 

-0.16 

31212 

* 

-1 

4955 

99 

1.21 

0.02 

0.00 

0.02 

31212 

A 

1 

35 

90 

1.07 

0.17 

0.98 

0.31 

31212 

B 

0 

4 

10 

0.07 

0.23 

0.61 

-0.31 

31212 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31212 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31213 

* 

-1 

4933 

99 

1.21 

0.02 

0.00 

0.03 

31213 

A 

1 

54 

89 

0.91 

0.14 

1.09 

0.21 

31213 

B 

0 

5 

8 

0.42 

0.15 

0.99 

-0.12 

31213 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31213 

D 

0 

2 

3 

-0.21 

0.08 

0.50 

-0.19 

31214 

* 

-1 

4942 

99 

1.21 

0.02 

0.00 

0.04 

31214 

A 

1 

33 

63 

1.00 

0.18 

0.94 

0.40 

31214 

B 

0 

6 

12 

0.77 

0.50 

2.42 

0.03 

31214 

C 

0 

6 

12 

-0.22 

0.27 

0.58 

-0.29 

31214 

D 

0 

7 

13 

-0.27 

0.35 

0.68 

-0.33 

31215 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

31215 

A 

1 

44 

77 

1.21 

0.21 

0.94 

0.45 

31215 

B 

0 

3 

5 

-0.29 

0.59 

0.72 

-0.19 

31215 

C 

0 

5 

9 

0.04 

0.54 

1.12 

-0.18 

31215 

D 

0 

5 

9 

-0.69 

0.31 

0.40 

-0.34 

31216 

* 

-1 

4933 

99 

1.21 

0.02 

0.00 

0.04 

31216 

A 

1 

42 

69 

1.40 

0.16 

0.67 

0.68 

31216 

B 

0 

9 

15 

-0.26 

0.08 

0.48 

-0.31 

31216 

C 

0 

2 

3 

0.10 

0.29 

0.70 

-0.09 

31216 

D 

0 

8 

13 

-1.21 

0.47 

0.34 

-0.56 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

31217 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.03 

31217 

A 

1 

44 

77 

0.85 

0.18 

1.38 

0.02 

31217 

B 

0 

7 

12 

1.07 

0.47 

4.07 

0.08 

31217 

C 

0 

2 

4 

0.13 

0.27 

0.70 

-0.12 

31217 

D 

0 

4 

7 

0.65 

0.35 

1.33 

-0.05 

31218 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.04 

31218 

A 

1 

36 

63 

1.06 

0.17 

1.12 

0.32 

31218 

B 

0 

4 

7 

0.89 

0.24 

1.25 

0.04 

31218 

C 

0 

10 

18 

0.82 

0.18 

1.24 

0.04 

31218 

D 

0 

7 

12 

-1.33 

0.99 

0.61 

-0.54 

31219 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.06 

31219 

A 

1 

36 

64 

0.81 

0.18 

0.94 

0.44 

31219 

B 

0 

8 

14 

0.27 

0.28 

1.30 

-0.04 

31219 

C 

0 

4 

7 

0.09 

0.53 

1.27 

-0.07 

31219 

D 

0 

8 

14 

-1.14 

0.43 

0.39 

-0.51 

31220 

* 

-1 

4937 

99 

1.21 

0.02 

0.00 

0.06 

31220 

A 

1 

24 

42 

0.82 

0.12 

0.85 

0.46 

31220 

B 

0 

2 

4 

-0.22 

0.07 

0.50 

-0.16 

31220 

C 

0 

15 

26 

0.15 

0.17 

0.86 

-0.22 

31220 

D 

0 

16 

28 

0.15 

0.21 

0.93 

-0.22 

31221 

* 

-1 

4946 

99 

1.21 

0.02 

0.00 

0.03 

31221 

A 

1 

35 

73 

0.99 

0.15 

0.92 

0.45 

31221 

B 

0 

4 

8 

-0.01 

0.15 

0.57 

-0.26 

31221 

C 

0 

1 

2 

-0.08 

0.00 

0.52 

-0.14 

31221 

D 

0 

8 

17 

0.17 

0.25 

0.81 

-0.29 

31222 

* 

-1 

4933 

99 

1.21 

0.02 

0.00 

0.03 

31222 

A 

1 

44 

72 

1.21 

0.14 

0.86 

0.49 

31222 

B 

0 

9 

15 

0.29 

0.38 

0.96 

-0.23 

31222 

C 

0 

3 

5 

-0.48 

0.77 

0.56 

-0.29 

31222 

D 

0 

5 

8 

-0.08 

0.33 

0.56 

-0.27 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

31223 

* 

-1 

1937 

39 

1.89 

0.03 

0.00 

0.40 

31223 

A 

1 

1729 

57 

1.23 

0.03 

1.01 

0.45 

31223 

B 

0 

364 

12 

0.36 

0.05 

1.07 

-0.13 

31223 

C 

0 

356 

12 

0.40 

0.05 

1.17 

-0.12 

31223 

D 

0 

608 

20 

-0.05 

0.04 

0.72 

-0.36 

31224 

* 

-1 

4945 

99 

1.21 

0.02 

0.00 

0.05 

31224 

A 

1 

19 

39 

1.32 

0.20 

0.75 

0.60 

31224 

B 

0 

6 

12 

-0.09 

0.51 

0.78 

-0.22 

31224 

C 

0 

11 

22 

0.27 

0.23 

0.90 

-0.13 

31224 

D 

0 

13 

27 

-0.13 

0.21 

0.59 

-0.37 

31225 

* 

-1 

4938 

99 

1.21 

0.02 

0.00 

0.04 

31225 

A 

1 

28 

50 

1.24 

0.21 

1.13 

0.49 

31225 

B 

0 

11 

20 

0.23 

0.23 

0.82 

-0.22 

31225 

C 

0 

4 

7 

0.20 

0.32 

0.72 

-0.13 

31225 

D 

0 

13 

23 

0.12 

0.22 

0.74 

-0.30 

3G1 1 

* 

-1 

4877 

98 

1.20 

0.02 

0.00 

-0.03 

3G1 1 

A 

1 

70 

60 

1.97 

0.14 

0.96 

0.50 

3G11 

B 

0 

38 

32 

0.73 

0.17 

0.87 

-0.38 

3G1 1 

C 

0 

9 

8 

0.28 

0.29 

0.51 

-0.26 

3G1 1 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G110 

* 

-1 

4743 

95 

1.16 

0.02 

0.00 

-0.13 

3G110 

A 

1 

235 

94 

2.10 

0.08 

0.91 

0.35 

3G110 

B 

0 

7 

3 

-0.05 

0.22 

0.27 

-0.28 

3G110 

C 

0 

9 

4 

0.61 

0.32 

0.69 

-0.21 

3G110 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G111 

* 

-1 

4881 

98 

1.18 

0.02 

0.00 

-0.10 

3G111 

A 

1 

106 

94 

2.20 

0.15 

1.04 

0.19 

3G111 

B 

0 

1 

1 

2.34 

0.00 

2.76 

0.01 

3G111 

C 

0 

6 

5 

0.73 

0.50 

1.04 

-0.21 

3G111 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3G112 

* 

-1 

4875 

98 

1.19 

0.02 

0.00 

-0.10 

3G112 

A 

1 

102 

86 

2.10 

0.12 

1.15 

0.15 

3G112 

B 

0 

13 

11 

1.46 

0.25 

1.23 

-0.16 

3G112 

C 

0 

4 

3 

1.91 

0.37 

1.67 

-0.02 

3G112 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G113 

* 

-1 

4870 

98 

1.19 

0.02 

0.00 

-0.10 

3G113 

A 

1 

123 

99 

2.00 

0.12 

1.02 

-0.10 

3G113 

B 

0 

1 

1 

3.45 

0.00 

7.73 

0.10 

3G113 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G113 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G114 

* 

-1 

4864 

97 

1.19 

0.02 

0.00 

-0.09 

3G114 

A 

1 

96 

74 

2.19 

0.12 

1.03 

0.38 

3G114 

B 

0 

20 

15 

1.02 

0.20 

0.80 

-0.31 

3G114 

C 

0 

14 

11 

1.24 

0.36 

1.69 

-0.19 

3G114 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G115 

* 

-1 

4876 

98 

1.19 

0.02 

0.00 

-0.07 

3G115 

A 

1 

110 

93 

1.86 

0.11 

1.00 

0.18 

3G115 

B 

0 

2 

2 

1.77 

0.07 

1.54 

0.00 

3G115 

C 

0 

6 

5 

0.75 

0.38 

0.84 

-0.21 

3G115 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G116 

* 

-1 

4861 

97 

1.18 

0.02 

0.00 

-0.12 

3G116 

A 

1 

127 

95 

2.22 

0.10 

1.04 

0.06 

3G116 

B 

0 

5 

4 

1.81 

0.61 

2.02 

-0.07 

3G116 

C 

0 

1 

1 

2.23 

0.00 

1.76 

0.00 

3G116 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G117 

* 

-1 

4881 

98 

1.18 

0.02 

0.00 

-0.12 

3G117 

A 

1 

85 

75 

2.66 

0.12 

0.87 

0.50 

3G117 

B 

0 

11 

10 

1.17 

0.26 

0.64 

-0.30 

3G117 

C 

0 

17 

15 

1.24 

0.22 

0.72 

-0.36 

3G117 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3G118 

* 

-1 

4886 

98 

1.20 

0.02 

0.00 

-0.05 

3G118 

A 

1 

83 

77 

1.92 

0.13 

1.03 

0.38 

3G118 

B 

0 

15 

14 

1.09 

0.23 

1.12 

-0.19 

3G118 

C 

0 

10 

9 

0.40 

0.24 

0.54 

-0.33 

3G118 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G119 

* 

-1 

4769 

95 

1.17 

0.02 

0.00 

-0.11 

3G119 

A 

1 

202 

90 

2.00 

0.07 

0.92 

0.37 

3G119 

B 

0 

18 

8 

0.81 

0.19 

0.70 

-0.29 

3G119 

C 

0 

5 

2 

0.31 

0.45 

0.45 

-0.22 

3G119 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G12 

* 

-1 

4884 

98 

1.17 

0.02 

0.00 

-0.16 

3G12 

A 

1 

107 

97 

2.71 

0.12 

0.97 

0.25 

3G12 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G12 

C 

0 

3 

3 

0.69 

0.13 

0.27 

-0.25 

3G12 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G120 

* 

-1 

4882 

98 

1.18 

0.02 

0.00 

-0.11 

3G120 

A 

1 

64 

57 

2.42 

0.14 

1.14 

0.27 

3G120 

B 

0 

2 

2 

1.76 

0.07 

0.76 

-0.05 

3G120 

C 

0 

46 

41 

1.82 

0.16 

1.52 

-0.26 

3G120 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G121 

* 

-1 

4864 

97 

1.19 

0.02 

0.00 

-0.09 

3G121 

A 

1 

73 

56 

2.44 

0.15 

1.00 

0.45 

3G121 

B 

0 

20 

15 

1.28 

0.24 

0.96 

-0.23 

3G121 

C 

0 

37 

28 

1.33 

0.14 

0.92 

-0.31 

3G121 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G122 

* 

-1 

4876 

98 

1.18 

0.02 

0.00 

-0.11 

3G122 

A 

1 

92 

78 

2.34 

0.14 

1.07 

0.31 

3G122 

B 

0 

23 

19 

1.49 

0.23 

1.29 

-0.23 

3G122 

C 

0 

3 

3 

0.20 

0.16 

0.23 

-0.23 

3G122 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

easyCBM  CCSS  Third  Grade  Math  Measure  Development 


424 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3G123 

* 

-1 

4874 

98 

1.19 

0.02 

0.00 

-0.08 

3G123 

A 

1 

94 

78 

2.08 

0.11 

1.02 

0.30 

3G123 

B 

0 

21 

18 

1.46 

0.19 

1.26 

-0.19 

3G123 

C 

0 

5 

4 

0.66 

0.24 

0.42 

-0.24 

3G123 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G124 

* 

-1 

4876 

98 

1.19 

0.02 

0.00 

-0.07 

3G124 

A 

1 

83 

70 

2.10 

0.11 

1.06 

0.41 

3G124 

B 

0 

17 

14 

1.38 

0.22 

1.07 

-0.17 

3G124 

C 

0 

18 

15 

0.97 

0.21 

0.71 

-0.35 

3G124 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G125 

* 

-1 

4884 

98 

1.20 

0.02 

0.00 

-0.04 

3G125 

A 

1 

85 

77 

1.74 

0.14 

1.13 

0.29 

3G125 

B 

0 

6 

5 

1.06 

0.35 

1.12 

-0.10 

3G125 

C 

0 

19 

17 

0.88 

0.18 

0.94 

-0.26 

3G125 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G126 

* 

-1 

4887 

98 

1.18 

0.02 

0.00 

-0.11 

3G126 

A 

1 

96 

90 

2.43 

0.14 

0.87 

0.40 

3G126 

B 

0 

1 

1 

-0.66 

0.00 

0.13 

-0.19 

3G126 

C 

0 

10 

9 

0.55 

0.41 

1.11 

-0.36 

3G126 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G127 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.10 

3G127 

A 

1 

110 

95 

2.12 

0.11 

0.95 

0.28 

3G127 

B 

0 

3 

3 

0.73 

0.62 

0.69 

-0.18 

3G127 

C 

0 

3 

3 

0.48 

0.56 

0.51 

-0.21 

3G127 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G128 

* 

-1 

4874 

98 

1.18 

0.02 

0.00 

-0.10 

3G128 

A 

1 

56 

47 

2.77 

0.16 

0.86 

0.54 

3G128 

B 

0 

39 

33 

1.51 

0.14 

0.88 

-0.30 

3G128 

C 

0 

25 

21 

1.29 

0.18 

0.68 

-0.31 

3G128 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3G129 

* 

-1 

4869 

97 

1.19 

0.02 

0.00 

-0.08 

3G129 

A 

1 

86 

69 

2.23 

0.13 

1.14 

0.39 

3G129 

B 

0 

19 

15 

1.03 

0.19 

0.71 

-0.30 

3G129 

C 

0 

20 

16 

1.32 

0.26 

1.53 

-0.20 

3G129 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G13 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.07 

3G13 

A 

1 

92 

79 

2.03 

0.12 

0.97 

0.35 

3G13 

B 

0 

6 

5 

0.54 

0.28 

0.49 

-0.26 

3G13 

C 

0 

18 

16 

1.17 

0.21 

1.20 

-0.24 

3G13 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G130 

* 

-1 

4869 

97 

1.18 

0.02 

0.00 

-0.12 

3G130 

A 

1 

90 

72 

2.49 

0.11 

1.02 

0.41 

3G130 

B 

0 

23 

18 

1.47 

0.14 

0.74 

-0.31 

3G130 

C 

0 

12 

10 

1.50 

0.34 

1.05 

-0.21 

3G130 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G131 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.12 

3G131 

A 

1 

69 

62 

2.75 

0.14 

1.01 

0.46 

3G131 

B 

0 

26 

23 

1.69 

0.15 

0.85 

-0.28 

3G131 

C 

0 

16 

14 

1.39 

0.28 

0.89 

-0.30 

3G131 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G132 

* 

-1 

4888 

98 

1.20 

0.02 

0.00 

-0.04 

3G132 

A 

1 

67 

63 

1.96 

0.15 

1.14 

0.39 

3G132 

B 

0 

16 

15 

1.23 

0.19 

1.04 

-0.14 

3G132 

C 

0 

23 

22 

0.86 

0.19 

0.82 

-0.33 

3G132 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G133 

* 

-1 

4886 

98 

1.17 

0.02 

0.00 

-0.16 

3G133 

A 

1 

70 

65 

3.16 

0.14 

0.97 

0.51 

3G133 

B 

0 

26 

24 

1.92 

0.19 

0.92 

-0.34 

3G133 

C 

0 

12 

11 

1.59 

0.27 

0.67 

-0.31 

3G133 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3G134 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.11 

3G134 

A 

1 

71 

64 

2.37 

0.14 

1.17 

0.25 

3G134 

B 

0 

21 

19 

1.77 

0.24 

1.37 

-0.17 

3G134 

C 

0 

19 

17 

1.81 

0.16 

1.05 

-0.14 

3G134 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G135 

* 

-1 

4873 

98 

1.19 

0.02 

0.00 

-0.09 

3G135 

A 

1 

95 

79 

2.21 

0.13 

0.99 

0.36 

3G135 

B 

0 

18 

15 

1.30 

0.13 

0.85 

-0.23 

3G135 

C 

0 

8 

7 

0.75 

0.27 

0.55 

-0.27 

3G135 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G136 

* 

-1 

4753 

95 

1.16 

0.02 

0.00 

-0.14 

3G136 

A 

1 

163 

68 

2.48 

0.10 

0.92 

0.51 

3G136 

B 

0 

71 

29 

1.09 

0.09 

0.75 

-0.47 

3G136 

C 

0 

7 

3 

1.02 

0.17 

0.52 

-0.14 

3G136 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G137 

* 

-1 

4879 

98 

1.18 

0.02 

0.00 

-0.11 

3G137 

A 

1 

80 

70 

2.61 

0.14 

0.92 

0.54 

3G137 

B 

0 

22 

19 

1.12 

0.19 

0.69 

-0.37 

3G137 

C 

0 

13 

11 

0.89 

0.19 

0.49 

-0.33 

3G137 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G138 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.08 

3G138 

A 

1 

69 

59 

2.18 

0.14 

1.29 

0.27 

3G138 

B 

0 

13 

11 

1.59 

0.22 

1.14 

-0.12 

3G138 

C 

0 

34 

29 

1.60 

0.14 

1.11 

-0.20 

3G138 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G139 

* 

-1 

4887 

98 

1.19 

0.02 

0.00 

-0.07 

3G139 

A 

1 

84 

79 

1.98 

0.11 

1.06 

0.32 

3G139 

B 

0 

10 

9 

0.72 

0.30 

0.58 

-0.33 

3G139 

C 

0 

13 

12 

1.50 

0.23 

1.26 

-0.11 

3G139 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3G14 

* 

-1 

4884 

98 

1.20 

0.02 

0.00 

-0.04 

3G14 

A 

1 

105 

95 

1.63 

0.11 

0.94 

0.28 

3G14 

B 

0 

2 

2 

0.07 

0.25 

0.40 

-0.17 

3G14 

C 

0 

3 

3 

0.02 

0.69 

0.61 

-0.21 

3G14 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G140 

* 

-1 

4887 

98 

1.18 

0.02 

0.00 

-0.11 

3G140 

A 

1 

91 

85 

2.50 

0.14 

0.82 

0.43 

3G140 

B 

0 

4 

4 

-0.19 

0.18 

0.20 

-0.32 

3G140 

C 

0 

12 

11 

0.94 

0.43 

1.46 

-0.30 

3G140 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G141 

* 

-1 

4880 

98 

1.19 

0.02 

0.00 

-0.10 

3G141 

A 

1 

71 

62 

2.34 

0.15 

1.22 

0.30 

3G141 

B 

0 

29 

25 

1.63 

0.18 

1.18 

-0.20 

3G141 

C 

0 

14 

12 

1.49 

0.30 

1.31 

-0.17 

3G141 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G142 

* 

-1 

4875 

98 

1.19 

0.02 

0.00 

-0.10 

3G142 

A 

1 

65 

55 

2.47 

0.16 

1.25 

0.36 

3G142 

B 

0 

37 

31 

1.42 

0.14 

0.87 

-0.34 

3G142 

C 

0 

17 

14 

1.85 

0.30 

2.37 

-0.07 

3G142 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G143 

* 

-1 

4869 

97 

1.19 

0.02 

0.00 

-0.08 

3G143 

A 

1 

74 

59 

2.48 

0.13 

0.84 

0.55 

3G143 

B 

0 

22 

18 

1.13 

0.24 

0.94 

-0.29 

3G143 

C 

0 

29 

23 

1.03 

0.16 

0.68 

-0.39 

3G143 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G144 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.07 

3G144 

A 

1 

77 

66 

2.09 

0.14 

1.10 

0.33 

3G144 

B 

0 

7 

6 

1.31 

0.33 

1.04 

-0.11 

3G144 

C 

0 

32 

28 

1.27 

0.16 

1.08 

-0.29 

3G144 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3G145 

* 

-1 

4871 

98 

1.18 

0.02 

0.00 

-0.12 

3G145 

A 

1 

96 

78 

2.48 

0.10 

0.91 

0.44 

3G145 

B 

0 

11 

9 

1.54 

0.31 

1.31 

-0.19 

3G145 

C 

0 

16 

13 

1.09 

0.23 

0.64 

-0.39 

3G145 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G146 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.12 

3G146 

A 

1 

75 

68 

2.67 

0.14 

1.08 

0.43 

3G146 

B 

0 

19 

17 

1.58 

0.18 

0.81 

-0.27 

3G146 

C 

0 

17 

15 

1.52 

0.23 

0.87 

-0.27 

3G146 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G147 

* 

-1 

4888 

98 

1.20 

0.02 

0.00 

-0.04 

3G147 

A 

1 

64 

60 

1.94 

0.16 

1.40 

0.34 

3G147 

B 

0 

24 

23 

1.23 

0.15 

1.03 

-0.17 

3G147 

C 

0 

18 

17 

0.95 

0.20 

0.84 

-0.25 

3G147 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G148 

* 

-1 

4888 

98 

1.17 

0.02 

0.00 

-0.17 

3G148 

A 

1 

88 

83 

2.88 

0.12 

0.95 

0.30 

3G148 

B 

0 

5 

5 

2.84 

0.66 

3.48 

0.02 

3G148 

C 

0 

13 

12 

1.51 

0.37 

1.28 

-0.36 

3G148 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G149 

* 

-1 

4884 

98 

1.18 

0.02 

0.00 

-0.11 

3G149 

A 

1 

71 

65 

2.36 

0.14 

1.20 

0.23 

3G149 

B 

0 

22 

20 

2.01 

0.22 

1.54 

-0.07 

3G149 

C 

0 

17 

15 

1.60 

0.19 

0.88 

-0.22 

3G149 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G15 

* 

-1 

4873 

98 

1.19 

0.02 

0.00 

-0.09 

3G15 

A 

1 

104 

86 

2.13 

0.12 

1.01 

0.32 

3G15 

B 

0 

7 

6 

0.97 

0.30 

0.73 

-0.21 

3G15 

C 

0 

10 

8 

1.07 

0.10 

0.65 

-0.22 

3G15 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

easyCBM  CCSS  Third  Grade  Math  Measure  Development 


429 

Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3G150 

* 

-1 

4880 

98 

1.18 

0.02 

0.00 

-0.11 

3G150 

A 

1 

102 

89 

2.17 

0.14 

1.20 

0.09 

3G150 

B 

0 

1 

1 

0.16 

0.00 

0.25 

-0.14 

3G150 

C 

0 

11 

10 

1.94 

0.24 

1.99 

-0.05 

3G150 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G151 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.08 

3G151 

A 

1 

107 

92 

2.04 

0.10 

0.97 

0.30 

3G151 

B 

0 

6 

5 

0.82 

0.25 

0.57 

-0.24 

3G151 

C 

0 

3 

3 

0.78 

0.15 

0.48 

-0.18 

3G151 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G152 

* 

-1 

4887 

98 

1.19 

0.02 

0.00 

-0.07 

3G152 

A 

1 

106 

99 

1.83 

0.10 

0.94 

0.26 

3G152 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G152 

C 

0 

1 

1 

-1.05 

0.00 

0.10 

-0.26 

3G152 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G153 

* 

-1 

4886 

98 

1.20 

0.02 

0.00 

-0.04 

3G153 

A 

1 

88 

81 

1.71 

0.13 

1.02 

0.29 

3G153 

B 

0 

11 

10 

0.57 

0.26 

0.79 

-0.27 

3G153 

C 

0 

9 

8 

1.12 

0.34 

1.36 

-0.11 

3G153 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G154 

* 

-1 

4887 

98 

1.18 

0.02 

0.00 

-0.11 

3G154 

A 

1 

77 

72 

2.64 

0.16 

1.06 

0.44 

3G154 

B 

0 

15 

14 

1.32 

0.30 

1.11 

-0.24 

3G154 

C 

0 

15 

14 

1.01 

0.32 

1.25 

-0.32 

3G154 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G155 

* 

-1 

4769 

95 

1.16 

0.02 

0.00 

-0.15 

3G155 

A 

1 

182 

81 

2.23 

0.10 

1.27 

0.17 

3G155 

B 

0 

29 

13 

1.76 

0.19 

2.17 

-0.10 

3G155 

C 

0 

14 

6 

1.41 

0.35 

1.57 

-0.13 

3G155 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3G156 

* 

-1 

4880 

98 

1.19 

0.02 

0.00 

-0.10 

3G156 

A 

1 

108 

95 

2.14 

0.11 

0.93 

0.31 

3G156 

B 

0 

3 

3 

0.42 

0.73 

0.61 

-0.22 

3G156 

C 

0 

3 

3 

0.51 

0.22 

0.40 

-0.21 

3G156 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G157 

* 

-1 

4875 

98 

1.19 

0.02 

0.00 

-0.10 

3G157 

A 

1 

92 

77 

2.26 

0.13 

1.08 

0.31 

3G157 

B 

0 

8 

7 

1.02 

0.44 

0.94 

-0.22 

3G157 

C 

0 

19 

16 

1.48 

0.20 

1.25 

-0.20 

3G157 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G158 

* 

-1 

4870 

98 

1.19 

0.02 

0.00 

-0.08 

3G158 

A 

1 

76 

61 

2.43 

0.13 

0.89 

0.53 

3G158 

B 

0 

22 

18 

0.91 

0.20 

0.76 

-0.37 

3G158 

C 

0 

26 

21 

1.20 

0.21 

1.04 

-0.29 

3G158 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G159 

* 

-1 

4879 

98 

1.19 

0.02 

0.00 

-0.07 

3G159 

A 

1 

83 

72 

2.04 

0.14 

1.15 

0.28 

3G159 

B 

0 

13 

11 

1.33 

0.24 

1.17 

-0.15 

3G159 

C 

0 

19 

17 

1.29 

0.16 

0.97 

-0.21 

3G159 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G16 

* 

-1 

4871 

98 

1.18 

0.02 

0.00 

-0.12 

3G16 

A 

1 

121 

98 

2.23 

0.10 

1.01 

0.13 

3G16 

B 

0 

1 

1 

0.29 

0.00 

0.26 

-0.16 

3G16 

C 

0 

1 

1 

1.88 

0.00 

1.25 

-0.03 

3G16 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G160 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.12 

3G160 

A 

1 

91 

82 

2.41 

0.13 

1.14 

0.19 

3G160 

B 

0 

10 

9 

1.93 

0.44 

2.32 

-0.10 

3G160 

C 

0 

10 

9 

1.71 

0.28 

1.22 

-0.15 

3G160 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3G161 

* 

-1 

4888 

98 

1.20 

0.02 

0.00 

-0.04 

3G161 

A 

1 

40 

38 

2.25 

0.21 

1.53 

0.42 

3G161 

B 

0 

36 

34 

1.12 

0.18 

0.94 

-0.30 

3G161 

C 

0 

30 

28 

1.35 

0.12 

0.86 

-0.14 

3G161 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G162 

* 

-1 

4888 

98 

1.17 

0.02 

0.00 

-0.17 

3G162 

A 

1 

89 

84 

2.92 

0.13 

0.91 

0.38 

3G162 

B 

0 

10 

9 

1.34 

0.37 

0.84 

-0.35 

3G162 

C 

0 

7 

7 

1.97 

0.41 

1.10 

-0.16 

3G162 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G163 

* 

-1 

4885 

98 

1.18 

0.02 

0.00 

-0.11 

3G163 

A 

1 

66 

61 

2.48 

0.15 

1.20 

0.33 

3G163 

B 

0 

18 

17 

1.49 

0.14 

0.71 

-0.27 

3G163 

C 

0 

25 

23 

1.86 

0.19 

1.21 

-0.15 

3G163 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G164 

* 

-1 

4875 

98 

1.19 

0.02 

0.00 

-0.09 

3G164 

A 

1 

72 

61 

2.26 

0.16 

1.19 

0.29 

3G164 

B 

0 

30 

25 

1.49 

0.17 

1.23 

-0.23 

3G164 

C 

0 

17 

14 

1.63 

0.23 

1.44 

-0.11 

3G164 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G165 

* 

-1 

4881 

98 

1.18 

0.02 

0.00 

-0.11 

3G165 

A 

1 

47 

42 

2.66 

0.22 

1.88 

0.33 

3G165 

B 

0 

48 

42 

1.78 

0.14 

1.09 

-0.23 

3G165 

C 

0 

18 

16 

1.71 

0.28 

1.22 

-0.14 

3G165 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G166 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.08 

3G166 

A 

1 

88 

76 

2.09 

0.12 

1.10 

0.23 

3G166 

B 

0 

20 

17 

1.63 

0.18 

1.33 

-0.13 

3G166 

C 

0 

8 

7 

1.14 

0.35 

0.93 

-0.20 

3G166 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3G167 

* 

-1 

4888 

98 

1.19 

0.02 

0.00 

-0.07 

3G167 

A 

1 

75 

71 

2.03 

0.12 

1.16 

0.34 

3G167 

B 

0 

7 

7 

0.60 

0.38 

0.51 

-0.30 

3G167 

C 

0 

24 

23 

1.44 

0.19 

1.31 

-0.19 

3G167 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G168 

* 

-1 

4883 

98 

1.20 

0.02 

0.00 

-0.04 

3G168 

A 

1 

64 

58 

2.01 

0.15 

0.95 

0.45 

3G168 

B 

0 

18 

16 

0.63 

0.22 

0.81 

-0.33 

3G168 

C 

0 

29 

26 

1.08 

0.17 

1.06 

-0.23 

3G168 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G169 

* 

-1 

4748 

95 

1.16 

0.02 

0.00 

-0.14 

3G169 

A 

1 

158 

64 

2.36 

0.09 

1.09 

0.40 

3G169 

B 

0 

23 

9 

1.17 

0.17 

0.70 

-0.24 

3G169 

C 

0 

65 

26 

1.48 

0.11 

1.14 

-0.28 

3G169 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G17 

* 

-1 

4886 

98 

1.18 

0.02 

0.00 

-0.11 

3G17 

A 

1 

97 

90 

2.35 

0.15 

1.07 

0.26 

3G17 

B 

0 

9 

8 

1.12 

0.35 

1.15 

-0.22 

3G17 

C 

0 

2 

2 

0.84 

1.77 

1.71 

-0.13 

3G17 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G170 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.10 

3G170 

A 

1 

47 

41 

2.49 

0.20 

1.51 

0.30 

3G170 

B 

0 

31 

27 

1.86 

0.18 

1.25 

-0.09 

3G170 

C 

0 

38 

33 

1.63 

0.16 

1.00 

-0.24 

3G170 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G171 

* 

-1 

4873 

98 

1.18 

0.02 

0.00 

-0.10 

3G171 

A 

1 

65 

54 

2.43 

0.17 

1.41 

0.33 

3G171 

B 

0 

2 

2 

1.26 

0.00 

0.51 

-0.08 

3G171 

C 

0 

54 

45 

1.63 

0.12 

1.08 

-0.31 

3G171 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3G172 

* 

-1 

4867 

97 

1.19 

0.02 

0.00 

-0.08 

3G172 

A 

1 

37 

29 

2.08 

0.24 

2.60 

0.09 

3G172 

B 

0 

29 

23 

1.29 

0.22 

0.87 

-0.27 

3G172 

C 

0 

61 

48 

2.10 

0.14 

1.79 

0.15 

3G172 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G173 

* 

-1 

4877 

98 

1.19 

0.02 

0.00 

-0.07 

3G173 

A 

1 

34 

29 

2.05 

0.20 

1.61 

0.13 

3G173 

B 

0 

33 

28 

1.74 

0.21 

1.81 

-0.04 

3G173 

C 

0 

50 

43 

1.71 

0.16 

1.60 

-0.08 

3G173 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G174 

* 

-1 

4868 

97 

1.18 

0.02 

0.00 

-0.12 

3G174 

A 

1 

75 

60 

2.61 

0.12 

0.99 

0.44 

3G174 

B 

0 

27 

21 

1.56 

0.22 

1.23 

-0.31 

3G174 

C 

0 

24 

19 

1.68 

0.13 

0.80 

-0.23 

3G174 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G175 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.12 

3G175 

A 

1 

69 

62 

2.61 

0.15 

1.23 

0.32 

3G175 

B 

0 

4 

4 

1.37 

0.40 

0.57 

-0.15 

3G175 

C 

0 

38 

34 

1.85 

0.16 

1.16 

-0.27 

3G175 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G176 

* 

-1 

4888 

98 

1.20 

0.02 

0.00 

-0.04 

3G176 

A 

1 

31 

29 

2.45 

0.22 

1.23 

0.46 

3G176 

B 

0 

52 

49 

1.24 

0.13 

0.94 

-0.31 

3G176 

C 

0 

23 

22 

1.34 

0.21 

0.92 

-0.12 

3G176 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G177 

* 

-1 

4885 

98 

1.17 

0.02 

0.00 

-0.16 

3G177 

A 

1 

100 

92 

2.77 

0.13 

1.05 

0.23 

3G177 

B 

0 

4 

4 

2.08 

0.42 

1.34 

-0.09 

3G177 

C 

0 

5 

5 

1.47 

0.46 

0.77 

-0.21 

3G177 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3G178 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.11 

3G178 

A 

1 

109 

98 

2.19 

0.11 

0.96 

0.21 

3G178 

B 

0 

2 

2 

0.44 

0.74 

0.39 

-0.21 

3G178 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G178 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G179 

* 

-1 

4774 

96 

1.18 

0.02 

0.00 

-0.07 

3G179 

A 

1 

210 

95 

1.71 

0.08 

1.03 

0.17 

3G179 

B 

0 

8 

4 

0.97 

0.31 

1.10 

-0.12 

3G179 

C 

0 

2 

1 

0.06 

0.02 

0.34 

-0.14 

3G179 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G18 

* 

-1 

4872 

98 

1.19 

0.02 

0.00 

-0.09 

3G18 

A 

1 

79 

65 

2.34 

0.14 

1.02 

0.42 

3G18 

B 

0 

13 

11 

1.14 

0.29 

1.19 

-0.23 

3G18 

C 

0 

30 

25 

1.31 

0.11 

0.79 

-0.30 

3G18 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G180 

* 

-1 

4878 

98 

1.18 

0.02 

0.00 

-0.11 

3G180 

A 

1 

87 

75 

2.40 

0.14 

1.20 

0.36 

3G180 

B 

0 

10 

9 

1.27 

0.32 

1.02 

-0.20 

3G180 

C 

0 

19 

16 

1.31 

0.20 

0.92 

-0.27 

3G180 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G19 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.08 

3G19 

A 

1 

96 

83 

2.07 

0.11 

1.00 

0.27 

3G19 

B 

0 

10 

9 

1.09 

0.28 

0.81 

-0.24 

3G19 

C 

0 

10 

9 

1.54 

0.28 

1.30 

-0.12 

3G19 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G21 

* 

-1 

4886 

98 

1.19 

0.02 

0.00 

-0.07 

3G21 

A 

1 

104 

96 

1.87 

0.10 

0.89 

0.34 

3G21 

B 

0 

2 

2 

-1.05 

0.00 

0.10 

-0.37 

3G21 

C 

0 

2 

2 

0.98 

0.50 

0.82 

-0.11 

3G21 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3G210 

* 

-1 

4883 

98 

1.20 

0.02 

0.00 

-0.04 

3G210 

A 

1 

103 

93 

1.66 

0.11 

0.91 

0.34 

3G210 

B 

0 

4 

4 

-0.20 

0.36 

0.37 

-0.28 

3G210 

C 

0 

4 

4 

0.36 

0.53 

0.83 

-0.19 

3G210 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G211 

* 

-1 

4886 

98 

1.18 

0.02 

0.00 

-0.11 

3G211 

A 

1 

97 

90 

2.42 

0.14 

0.93 

0.40 

3G211 

B 

0 

7 

6 

0.51 

0.45 

0.93 

-0.30 

3G211 

C 

0 

4 

4 

0.28 

0.47 

0.45 

-0.25 

3G211 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G212 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.10 

3G212 

A 

1 

110 

95 

2.12 

0.11 

0.95 

0.27 

3G212 

B 

0 

2 

2 

0.02 

0.26 

0.24 

-0.22 

3G212 

C 

0 

4 

3 

0.94 

0.54 

0.86 

-0.17 

3G212 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G213 

* 

-1 

4873 

98 

1.18 

0.02 

0.00 

-0.10 

3G213 

A 

1 

114 

94 

2.14 

0.11 

0.92 

0.29 

3G213 

B 

0 

3 

2 

0.71 

1.09 

1.45 

-0.17 

3G213 

C 

0 

4 

3 

0.52 

0.48 

0.54 

-0.23 

3G213 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G214 

* 

-1 

4774 

96 

1.15 

0.02 

0.00 

-0.19 

3G214 

A 

1 

191 

87 

2.58 

0.09 

0.95 

0.33 

3G214 

B 

0 

29 

13 

1.39 

0.18 

0.89 

-0.33 

3G214 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G214 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G215 

* 

-1 

4867 

97 

1.19 

0.02 

0.00 

-0.08 

3G215 

A 

1 

116 

91 

2.01 

0.11 

1.02 

0.27 

3G215 

B 

0 

8 

6 

0.87 

0.36 

1.00 

-0.22 

3G215 

C 

0 

3 

2 

0.64 

0.50 

0.62 

-0.16 

3G215 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3G216 

* 

-1 

4877 

98 

1.19 

0.02 

0.00 

-0.07 

3G216 

A 

1 

111 

95 

1.88 

0.11 

0.98 

0.23 

3G216 

B 

0 

4 

3 

0.28 

0.17 

0.37 

-0.25 

3G216 

C 

0 

2 

2 

1.51 

0.34 

1.27 

-0.03 

3G216 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G217 

* 

-1 

4868 

97 

1.18 

0.02 

0.00 

-0.12 

3G217 

A 

1 

124 

98 

2.24 

0.10 

0.97 

0.22 

3G217 

B 

0 

1 

1 

-0.28 

0.00 

0.14 

-0.20 

3G217 

C 

0 

1 

1 

0.84 

0.00 

0.44 

-0.11 

3G217 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G218 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.12 

3G218 

A 

1 

107 

96 

2.39 

0.11 

0.90 

0.35 

3G218 

B 

0 

1 

1 

0.20 

0.00 

0.22 

-0.16 

3G218 

C 

0 

3 

3 

0.07 

0.13 

0.20 

-0.30 

3G218 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G219 

* 

-1 

4888 

98 

1.20 

0.02 

0.00 

-0.04 

3G219 

A 

1 

100 

94 

1.69 

0.11 

0.93 

0.27 

3G219 

B 

0 

4 

4 

0.65 

0.70 

1.15 

-0.16 

3G219 

C 

0 

2 

2 

-0.43 

0.29 

0.23 

-0.24 

3G219 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G22 

* 

-1 

4885 

98 

1.17 

0.02 

0.00 

-0.16 

3G22 

A 

1 

100 

92 

2.77 

0.12 

0.97 

0.23 

3G22 

B 

0 

5 

5 

2.13 

0.75 

2.74 

-0.10 

3G22 

C 

0 

4 

4 

1.19 

0.64 

0.75 

-0.23 

3G22 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G220 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.11 

3G220 

A 

1 

109 

98 

2.18 

0.11 

0.96 

0.12 

3G220 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G220 

C 

0 

2 

2 

1.16 

1.62 

1.63 

-0.12 

3G220 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3G23 

* 

-1 

4775 

96 

1.17 

0.02 

0.00 

-0.13 

3G23 

A 

1 

207 

95 

2.06 

0.09 

1.00 

0.24 

3G23 

B 

0 

8 

4 

0.78 

0.37 

0.91 

-0.18 

3G23 

C 

0 

4 

2 

0.55 

0.51 

0.70 

-0.16 

3G23 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G24 

* 

-1 

4872 

98 

1.19 

0.02 

0.00 

-0.09 

3G24 

A 

1 

118 

97 

2.00 

0.11 

0.98 

0.18 

3G24 

B 

0 

4 

3 

0.75 

0.36 

0.60 

-0.18 

3G24 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G24 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G25 

* 

-1 

4878 

98 

1.18 

0.02 

0.00 

-0.11 

3G25 

A 

1 

106 

91 

2.31 

0.12 

0.82 

0.46 

3G25 

B 

0 

8 

7 

0.17 

0.27 

0.34 

-0.40 

3G25 

C 

0 

2 

2 

0.09 

0.06 

0.24 

-0.20 

3G25 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G26 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.08 

3G26 

A 

1 

104 

90 

2.05 

0.10 

0.97 

0.30 

3G26 

B 

0 

9 

8 

0.86 

0.30 

0.86 

-0.29 

3G26 

C 

0 

3 

3 

1.32 

0.09 

0.80 

-0.09 

3G26 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G27 

* 

-1 

4886 

98 

1.19 

0.02 

0.00 

-0.07 

3G27 

A 

1 

97 

90 

1.90 

0.10 

0.97 

0.27 

3G27 

B 

0 

2 

2 

-0.01 

1.04 

0.39 

-0.24 

3G27 

C 

0 

9 

8 

1.17 

0.39 

1.37 

-0.18 

3G27 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3G28 

* 

-1 

4887 

98 

1.20 

0.02 

0.00 

-0.04 

3G28 

A 

1 

94 

88 

1.72 

0.12 

0.86 

0.40 

3G28 

B 

0 

6 

6 

0.46 

0.57 

1.58 

-0.22 

3G28 

C 

0 

7 

7 

0.02 

0.22 

0.42 

-0.33 

3G28 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3G29 

* 

-1 

4887 

98 

1.18 

0.02 

0.00 

-0.11 

3G29 

A 

1 

104 

97 

2.28 

0.15 

1.03 

0.20 

3G29 

B 

0 

2 

2 

0.27 

0.06 

0.37 

-0.18 

3G29 

C 

0 

1 

1 

0.70 

0.00 

0.58 

-0.10 

3G29 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD11 

* 

-1 

4877 

98 

1.20 

0.02 

0.00 

-0.03 

3MD11 

A 

1 

88 

75 

1.71 

0.13 

1.04 

0.36 

3MD11 

B 

0 

20 

17 

0.34 

0.27 

0.85 

-0.39 

3MD11 

C 

0 

9 

8 

1.26 

0.39 

2.22 

-0.04 

3MD11 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD110 

* 

-1 

4884 

98 

1.18 

0.02 

0.00 

-0.11 

3MD110 

A 

1 

95 

86 

2.45 

0.14 

0.91 

0.43 

3MD110 

B 

0 

11 

10 

0.57 

0.25 

0.55 

-0.36 

3MD110 

C 

0 

4 

4 

0.50 

0.78 

0.85 

-0.22 

3MD110 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD111 

* 

-1 

4876 

98 

1.19 

0.02 

0.00 

-0.10 

3MD111 

A 

1 

88 

75 

2.38 

0.12 

0.92 

0.49 

3MD111 

B 

0 

14 

12 

1.15 

0.24 

0.84 

-0.27 

3MD111 

C 

0 

16 

14 

0.91 

0.17 

0.56 

-0.37 

3MD111 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD112 

* 

-1 

4871 

98 

1.18 

0.02 

0.00 

-0.10 

3MD112 

A 

1 

102 

83 

2.29 

0.12 

0.93 

0.43 

3MD112 

B 

0 

12 

10 

1.05 

0.21 

0.71 

-0.26 

3MD112 

C 

0 

9 

7 

0.61 

0.27 

0.49 

-0.33 

3MD112 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD113 

* 

-1 

4865 

97 

1.19 

0.02 

0.00 

-0.09 

3MD113 

A 

1 

75 

58 

2.44 

0.13 

0.87 

0.50 

3MD113 

B 

0 

34 

26 

0.95 

0.17 

0.74 

-0.46 

3MD113 

C 

0 

20 

16 

1.56 

0.25 

1.37 

-0.12 

3MD113 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3MD12 

* 

-1 

4877 

98 

1.19 

0.02 

0.00 

-0.07 

3MD12 

A 

1 

87 

74 

2.10 

0.13 

1.01 

0.41 

3MD12 

B 

0 

24 

21 

0.96 

0.14 

0.71 

-0.38 

3MD12 

C 

0 

6 

5 

1.17 

0.18 

0.76 

-0.13 

3MD12 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD13 

* 

-1 

4861 

97 

1.18 

0.02 

0.00 

-0.12 

3MD13 

A 

1 

63 

47 

2.64 

0.14 

1.16 

0.37 

3MD13 

B 

0 

37 

28 

1.91 

0.19 

1.47 

-0.16 

3MD13 

C 

0 

33 

25 

1.71 

0.15 

0.88 

-0.25 

3MD13 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD14 

* 

-1 

4881 

98 

1.18 

0.02 

0.00 

-0.12 

3MD14 

A 

1 

77 

68 

2.57 

0.15 

1.23 

0.31 

3MD14 

B 

0 

13 

12 

2.07 

0.28 

1.48 

-0.07 

3MD14 

C 

0 

23 

20 

1.56 

0.19 

0.96 

-0.30 

3MD14 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD15 

* 

-1 

4886 

98 

1.20 

0.02 

0.00 

-0.05 

3MD15 

A 

1 

62 

57 

2.11 

0.17 

1.34 

0.42 

3MD15 

B 

0 

22 

20 

1.05 

0.15 

0.79 

-0.25 

3MD15 

C 

0 

24 

22 

1.08 

0.19 

0.98 

-0.25 

3MD15 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD16 

* 

-1 

4774 

96 

1.18 

0.02 

0.00 

-0.07 

3MD16 

A 

1 

118 

54 

2.08 

0.10 

1.18 

0.39 

3MD16 

B 

0 

49 

22 

1.41 

0.13 

1.19 

-0.12 

3MD16 

C 

0 

53 

24 

1.01 

0.14 

1.07 

-0.33 

3MD16 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD17 

* 

-1 

4885 

98 

1.17 

0.02 

0.00 

-0.16 

3MD17 

A 

1 

93 

85 

2.86 

0.13 

1.02 

0.34 

3MD17 

B 

0 

10 

9 

1.49 

0.34 

0.82 

-0.30 

3MD17 

C 

0 

6 

6 

1.93 

0.27 

0.91 

-0.14 

3MD17 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3MD18 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.11 

3MD18 

A 

1 

74 

67 

2.56 

0.13 

0.91 

0.51 

3MD18 

B 

0 

26 

23 

1.48 

0.11 

0.73 

-0.34 

3MD18 

C 

0 

11 

10 

1.07 

0.27 

0.57 

-0.32 

3MD18 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD19 

* 

-1 

4865 

97 

1.19 

0.02 

0.00 

-0.09 

3MD19 

A 

1 

49 

38 

2.47 

0.19 

1.26 

0.33 

3MD19 

B 

0 

31 

24 

1.49 

0.20 

1.06 

-0.20 

3MD19 

C 

0 

49 

38 

1.71 

0.16 

1.57 

-0.15 

3MD19 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD21 

* 

-1 

4876 

98 

1.18 

0.02 

0.00 

-0.11 

3MD21 

A 

1 

94 

80 

2.41 

0.13 

0.95 

0.44 

3MD21 

B 

0 

21 

18 

0.94 

0.21 

0.80 

-0.41 

3MD21 

C 

0 

3 

3 

1.21 

0.83 

1.27 

-0.11 

3MD21 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD210 

* 

-1 

4875 

98 

1.19 

0.02 

0.00 

-0.08 

3MD210 

A 

1 

65 

55 

2.39 

0.14 

0.93 

0.48 

3MD210 

B 

0 

31 

26 

1.15 

0.12 

0.64 

-0.42 

3MD210 

C 

0 

23 

19 

1.61 

0.16 

1.04 

-0.14 

3MD210 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD211 

* 

-1 

4877 

98 

1.19 

0.02 

0.00 

-0.07 

3MD211 

A 

1 

107 

91 

1.95 

0.09 

0.93 

0.40 

3MD211 

B 

0 

6 

5 

0.68 

0.32 

0.64 

-0.25 

3MD211 

C 

0 

4 

3 

0.12 

0.55 

0.45 

-0.31 

3MD211 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD212 

* 

-1 

4883 

98 

1.20 

0.02 

0.00 

-0.04 

3MD212 

A 

1 

90 

81 

1.74 

0.13 

1.02 

0.35 

3MD212 

B 

0 

13 

12 

0.79 

0.21 

0.89 

-0.23 

3MD212 

C 

0 

8 

7 

0.51 

0.29 

0.69 

-0.24 

3MD212 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3MD213 

* 

-1 

4887 

98 

1.18 

0.02 

0.00 

-0.11 

3MD213 

A 

1 

89 

83 

2.56 

0.15 

0.90 

0.50 

3MD213 

B 

0 

14 

13 

0.40 

0.24 

0.47 

-0.47 

3MD213 

C 

0 

4 

4 

1.13 

0.40 

0.85 

-0.14 

3MD213 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD22 

* 

-1 

4770 

96 

1.16 

0.02 

0.00 

-0.15 

3MD22 

A 

1 

193 

86 

2.40 

0.09 

0.84 

0.51 

3MD22 

B 

0 

11 

5 

0.28 

0.20 

0.36 

-0.31 

3MD22 

C 

0 

20 

9 

0.45 

0.13 

0.40 

-0.38 

3MD22 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD23 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.10 

3MD23 

A 

1 

84 

72 

2.38 

0.13 

0.93 

0.45 

3MD23 

B 

0 

8 

7 

1.16 

0.35 

0.83 

-0.20 

3MD23 

C 

0 

24 

21 

1.16 

0.18 

0.86 

-0.37 

3MD23 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD24 

* 

-1 

4873 

98 

1.18 

0.02 

0.00 

-0.10 

3MD24 

A 

1 

81 

67 

2.42 

0.14 

1.01 

0.42 

3MD24 

B 

0 

29 

24 

1.54 

0.15 

1.04 

-0.23 

3MD24 

C 

0 

11 

9 

0.67 

0.29 

0.50 

-0.35 

3MD24 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD25 

* 

-1 

4867 

97 

1.19 

0.02 

0.00 

-0.08 

3MD25 

A 

1 

88 

69 

2.40 

0.12 

0.82 

0.60 

3MD25 

B 

0 

23 

18 

0.80 

0.17 

0.58 

-0.42 

3MD25 

C 

0 

16 

13 

0.77 

0.20 

0.58 

-0.35 

3MD25 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD26 

* 

-1 

4877 

98 

1.19 

0.02 

0.00 

-0.07 

3MD26 

A 

1 

80 

68 

2.21 

0.13 

0.91 

0.49 

3MD26 

B 

0 

16 

14 

0.77 

0.14 

0.52 

-0.36 

3MD26 

C 

0 

21 

18 

1.13 

0.17 

0.85 

-0.28 

3MD26 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3MD27 

* 

-1 

4869 

97 

1.18 

0.02 

0.00 

-0.12 

3MD27 

A 

1 

70 

56 

2.68 

0.13 

1.00 

0.47 

3MD27 

B 

0 

22 

18 

1.67 

0.18 

0.95 

-0.22 

3MD27 

C 

0 

33 

26 

1.57 

0.16 

0.81 

-0.34 

3MD27 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD28 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.12 

3MD28 

A 

1 

106 

95 

2.39 

0.11 

0.93 

0.33 

3MD28 

B 

0 

3 

3 

0.27 

0.30 

0.26 

-0.28 

3MD28 

C 

0 

2 

2 

0.64 

0.06 

0.34 

-0.18 

3MD28 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD29 

* 

-1 

4888 

98 

1.20 

0.02 

0.00 

-0.04 

3MD29 

A 

1 

65 

61 

2.18 

0.13 

0.77 

0.60 

3MD29 

B 

0 

31 

29 

0.77 

0.14 

0.69 

-0.46 

3MD29 

C 

0 

10 

9 

0.58 

0.28 

0.54 

-0.28 

3MD29 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD31 

* 

-1 

4885 

98 

1.17 

0.02 

0.00 

-0.16 

3MD31 

A 

1 

91 

83 

2.92 

0.12 

0.94 

0.43 

3MD31 

B 

0 

11 

10 

1.69 

0.30 

0.87 

-0.26 

3MD31 

C 

0 

7 

6 

1.14 

0.22 

0.38 

-0.32 

3MD31 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD310 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.11 

3MD310 

A 

1 

69 

62 

2.39 

0.14 

1.21 

0.27 

3MD310 

B 

0 

27 

24 

1.75 

0.15 

1.07 

-0.20 

3MD310 

C 

0 

15 

14 

1.82 

0.32 

1.73 

-0.12 

3MD310 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD311 

* 

-1 

4872 

98 

1.19 

0.02 

0.00 

-0.09 

3MD311 

A 

1 

72 

59 

2.49 

0.14 

0.94 

0.52 

3MD311 

B 

0 

37 

30 

1.24 

0.13 

0.97 

-0.39 

3MD311 

C 

0 

13 

11 

1.07 

0.23 

0.77 

-0.25 

3MD311 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

easyCBM  CCSS  Third  Grade  Math  Measure  Development 


443 

Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3MD312 

* 

-1 

4878 

98 

1.18 

0.02 

0.00 

-0.11 

3MD312 

A 

1 

88 

76 

2.56 

0.13 

0.82 

0.58 

3MD312 

B 

0 

18 

16 

0.65 

0.17 

0.43 

-0.48 

3MD312 

C 

0 

10 

9 

0.95 

0.20 

0.54 

-0.27 

3MD312 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD313 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.08 

3MD313 

A 

1 

75 

65 

2.29 

0.12 

0.90 

0.44 

3MD313 

B 

0 

35 

30 

1.31 

0.16 

1.07 

-0.38 

3MD313 

C 

0 

6 

5 

1.25 

0.31 

0.76 

-0.15 

3MD313 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD32 

* 

-1 

4886 

98 

1.19 

0.02 

0.00 

-0.07 

3MD32 

A 

1 

53 

49 

2.03 

0.14 

1.49 

0.21 

3MD32 

B 

0 

31 

29 

1.62 

0.19 

1.59 

-0.11 

3MD32 

C 

0 

24 

22 

1.53 

0.22 

1.20 

-0.14 

3MD32 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD33 

* 

-1 

4884 

98 

1.20 

0.02 

0.00 

-0.04 

3MD33 

A 

1 

56 

51 

2.01 

0.16 

1.15 

0.38 

3MD33 

B 

0 

33 

30 

0.89 

0.15 

0.91 

-0.36 

3MD33 

C 

0 

21 

19 

1.41 

0.25 

1.60 

-0.06 

3MD33 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD34 

* 

-1 

4887 

98 

1.18 

0.02 

0.00 

-0.11 

3MD34 

A 

1 

85 

79 

2.49 

0.16 

1.30 

0.35 

3MD34 

B 

0 

6 

6 

1.60 

0.57 

2.03 

-0.10 

3MD34 

C 

0 

16 

15 

1.03 

0.19 

0.71 

-0.33 

3MD34 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD35 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.10 

3MD35 

A 

1 

65 

56 

2.68 

0.14 

0.80 

0.60 

3MD35 

B 

0 

23 

20 

1.54 

0.16 

1.00 

-0.20 

3MD35 

C 

0 

28 

24 

0.96 

0.15 

0.52 

-0.50 

3MD35 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3MD36 

* 

-1 

4874 

98 

1.18 

0.02 

0.00 

-0.10 

3MD36 

A 

1 

55 

46 

2.54 

0.19 

1.53 

0.36 

3MD36 

B 

0 

45 

38 

1.73 

0.13 

1.10 

-0.20 

3MD36 

C 

0 

20 

17 

1.42 

0.20 

0.88 

-0.23 

3MD36 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD37 

* 

-1 

4869 

97 

1.19 

0.02 

0.00 

-0.08 

3MD37 

A 

1 

85 

68 

2.35 

0.12 

0.92 

0.51 

3MD37 

B 

0 

26 

21 

1.07 

0.20 

0.92 

-0.34 

3MD37 

C 

0 

14 

11 

0.79 

0.21 

0.56 

-0.32 

3MD37 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD38 

* 

-1 

4745 

95 

1.17 

0.02 

0.00 

-0.13 

3MD38 

A 

1 

149 

60 

2.25 

0.11 

1.35 

0.26 

3MD38 

B 

0 

15 

6 

0.68 

0.24 

0.51 

-0.26 

3MD38 

C 

0 

85 

34 

1.74 

0.11 

1.54 

-0.14 

3MD38 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD39 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.07 

3MD39 

A 

1 

75 

65 

2.20 

0.13 

0.97 

0.44 

3MD39 

B 

0 

24 

21 

1.19 

0.15 

0.86 

-0.28 

3MD39 

C 

0 

17 

15 

1.03 

0.23 

0.91 

-0.28 

3MD39 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD41 

* 

-1 

4869 

97 

1.18 

0.02 

0.00 

-0.12 

3MD41 

A 

1 

119 

95 

2.29 

0.10 

0.92 

0.34 

3MD41 

B 

0 

1 

1 

1.26 

0.00 

0.64 

-0.08 

3MD41 

C 

0 

5 

4 

0.40 

0.38 

0.37 

-0.33 

3MD41 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD410 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.12 

3MD410 

A 

1 

42 

38 

2.65 

0.24 

2.04 

0.22 

3MD410 

B 

0 

41 

37 

2.27 

0.13 

1.19 

-0.02 

3MD410 

C 

0 

28 

25 

1.83 

0.19 

0.96 

-0.22 

3MD410 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3MD411 

* 

-1 

4748 

95 

1.16 

0.02 

0.00 

-0.14 

3MD411 

A 

1 

225 

91 

2.15 

0.07 

0.91 

0.38 

3MD411 

B 

0 

15 

6 

0.49 

0.19 

0.48 

-0.34 

3MD411 

C 

0 

6 

2 

0.83 

0.26 

0.59 

-0.16 

3MD411 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD412 

* 

-1 

4888 

98 

1.20 

0.02 

0.00 

-0.04 

3MD412 

A 

1 

35 

33 

2.28 

0.22 

1.58 

0.39 

3MD412 

B 

0 

60 

57 

1.43 

0.13 

1.14 

-0.18 

3MD412 

C 

0 

11 

10 

0.53 

0.16 

0.32 

-0.31 

3MD412 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD413 

* 

-1 

4886 

98 

1.17 

0.02 

0.00 

-0.16 

3MD413 

A 

1 

46 

43 

3.55 

0.17 

0.90 

0.59 

3MD413 

B 

0 

48 

44 

2.04 

0.13 

0.75 

-0.46 

3MD413 

C 

0 

14 

13 

2.07 

0.25 

0.73 

-0.19 

3MD413 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD42 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.11 

3MD42 

A 

1 

95 

86 

2.34 

0.11 

0.95 

0.38 

3MD42 

B 

0 

9 

8 

1.25 

0.23 

0.73 

-0.24 

3MD42 

C 

0 

7 

6 

0.96 

0.31 

0.57 

-0.28 

3MD42 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD43 

* 

-1 

4873 

98 

1.19 

0.02 

0.00 

-0.09 

3MD43 

A 

1 

94 

78 

2.06 

0.13 

1.14 

0.13 

3MD43 

B 

0 

7 

6 

1.28 

0.24 

0.83 

-0.14 

3MD43 

C 

0 

20 

17 

1.83 

0.30 

3.66 

-0.05 

3MD43 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD44 

* 

-1 

4879 

98 

1.18 

0.02 

0.00 

-0.11 

3MD44 

A 

1 

85 

74 

2.50 

0.14 

1.02 

0.46 

3MD44 

B 

0 

13 

11 

1.11 

0.25 

0.76 

-0.27 

3MD44 

C 

0 

17 

15 

1.07 

0.20 

0.67 

-0.33 

3MD44 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3MD45 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.08 

3MD45 

A 

1 

74 

64 

2.10 

0.14 

1.28 

0.20 

3MD45 

B 

0 

24 

21 

1.72 

0.18 

1.39 

-0.11 

3MD45 

C 

0 

18 

16 

1.59 

0.17 

1.05 

-0.14 

3MD45 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD46 

* 

-1 

4887 

98 

1.19 

0.02 

0.00 

-0.07 

3MD46 

A 

1 

56 

52 

2.15 

0.12 

0.99 

0.35 

3MD46 

B 

0 

27 

25 

1.42 

0.21 

1.24 

-0.21 

3MD46 

C 

0 

24 

22 

1.43 

0.23 

1.15 

-0.19 

3MD46 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD47 

* 

-1 

4884 

98 

1.20 

0.02 

0.00 

-0.04 

3MD47 

A 

1 

74 

67 

2.01 

0.13 

0.79 

0.55 

3MD47 

B 

0 

16 

15 

0.74 

0.20 

0.77 

-0.28 

3MD47 

C 

0 

20 

18 

0.51 

0.21 

0.79 

-0.41 

3MD47 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD48 

* 

-1 

4887 

98 

1.18 

0.02 

0.00 

-0.11 

3MD48 

A 

1 

65 

61 

2.79 

0.18 

1.10 

0.47 

3MD48 

B 

0 

18 

17 

1.22 

0.35 

1.64 

-0.30 

3MD48 

C 

0 

24 

22 

1.45 

0.21 

0.94 

-0.28 

3MD48 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD49 

* 

-1 

4880 

98 

1.19 

0.02 

0.00 

-0.10 

3MD49 

A 

1 

53 

46 

2.52 

0.18 

1.26 

0.36 

3MD49 

B 

0 

28 

25 

1.69 

0.19 

1.35 

-0.17 

3MD49 

C 

0 

33 

29 

1.61 

0.18 

1.06 

-0.23 

3MD49 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD51 

* 

-1 

4875 

98 

1.19 

0.02 

0.00 

-0.10 

3MD51 

A 

1 

110 

92 

2.14 

0.12 

0.99 

0.26 

3MD51 

B 

0 

4 

3 

0.55 

0.43 

0.49 

-0.22 

3MD51 

C 

0 

5 

4 

1.22 

0.57 

1.51 

-0.14 

3MD51 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3MD510 

* 

-1 

4869 

97 

1.19 

0.02 

0.00 

-0.08 

3MD510 

A 

1 

102 

82 

2.15 

0.12 

0.92 

0.41 

3MD510 

B 

0 

13 

10 

0.76 

0.26 

0.74 

-0.31 

3MD510 

C 

0 

10 

8 

0.88 

0.40 

1.28 

-0.24 

3MD510 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD511 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.07 

3MD511 

A 

1 

79 

68 

1.90 

0.14 

1.27 

0.10 

3MD511 

B 

0 

27 

23 

1.93 

0.20 

2.13 

0.05 

3MD511 

C 

0 

10 

9 

0.89 

0.22 

0.65 

-0.24 

3MD511 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD512 

* 

-1 

4871 

98 

1.18 

0.02 

0.00 

-0.12 

3MD512 

A 

1 

77 

63 

2.47 

0.13 

1.20 

0.29 

3MD512 

B 

0 

35 

28 

1.97 

0.15 

1.32 

-0.14 

3MD512 

C 

0 

11 

9 

1.20 

0.29 

0.59 

-0.28 

3MD512 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD52 

* 

-1 

4776 

96 

1.17 

0.02 

0.00 

-0.12 

3MD52 

A 

1 

202 

93 

2.05 

0.09 

1.01 

0.19 

3MD52 

B 

0 

7 

3 

1.12 

0.62 

2.21 

-0.12 

3MD52 

C 

0 

9 

4 

1.11 

0.31 

1.14 

-0.14 

3MD52 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD53 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.12 

3MD53 

A 

1 

101 

91 

2.40 

0.12 

0.98 

0.24 

3MD53 

B 

0 

4 

4 

0.67 

0.30 

0.38 

-0.26 

3MD53 

C 

0 

6 

5 

1.82 

0.58 

2.12 

-0.09 

3MD53 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD54 

* 

-1 

4888 

98 

1.20 

0.02 

0.00 

-0.04 

3MD54 

A 

1 

85 

80 

1.87 

0.12 

0.87 

0.44 

3MD54 

B 

0 

9 

8 

0.36 

0.18 

0.46 

-0.32 

3MD54 

C 

0 

12 

11 

0.74 

0.39 

1.46 

-0.26 

3MD54 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3MD55 

* 

-1 

4888 

98 

1.17 

0.02 

0.00 

-0.17 

3MD55 

A 

1 

81 

76 

2.96 

0.13 

0.99 

0.35 

3MD55 

B 

0 

14 

13 

1.98 

0.31 

1.20 

-0.23 

3MD55 

C 

0 

11 

10 

1.83 

0.38 

1.11 

-0.24 

3MD55 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD56 

* 

-1 

4884 

98 

1.18 

0.02 

0.00 

-0.11 

3MD56 

A 

1 

36 

33 

2.73 

0.22 

1.29 

0.35 

3MD56 

B 

0 

65 

59 

1.97 

0.11 

1.05 

-0.21 

3MD56 

C 

0 

9 

8 

1.40 

0.35 

0.66 

-0.21 

3MD56 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD57 

* 

-1 

4873 

98 

1.19 

0.02 

0.00 

-0.09 

3MD57 

A 

1 

114 

94 

2.04 

0.11 

0.99 

0.20 

3MD57 

B 

0 

4 

3 

0.85 

0.50 

0.79 

-0.17 

3MD57 

C 

0 

3 

2 

1.16 

0.22 

0.77 

-0.11 

3MD57 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD58 

* 

-1 

4880 

98 

1.18 

0.02 

0.00 

-0.11 

3MD58 

A 

1 

110 

96 

2.17 

0.13 

1.00 

0.18 

3MD58 

B 

0 

3 

3 

1.24 

0.63 

1.22 

-0.11 

3MD58 

C 

0 

1 

1 

-0.37 

0.00 

0.17 

-0.18 

3MD58 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD59 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.08 

3MD59 

A 

1 

107 

92 

2.03 

0.10 

0.96 

0.29 

3MD59 

B 

0 

2 

2 

0.49 

0.00 

0.35 

-0.18 

3MD59 

C 

0 

7 

6 

0.96 

0.31 

0.76 

-0.23 

3MD59 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD61 

* 

-1 

4887 

98 

1.19 

0.02 

0.00 

-0.07 

3MD61 

A 

1 

26 

24 

2.61 

0.14 

0.70 

0.44 

3MD61 

B 

0 

19 

18 

0.93 

0.24 

0.53 

-0.39 

3MD61 

C 

0 

62 

58 

1.73 

0.12 

1.13 

-0.08 

3MD61 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3MD610 

* 

-1 

4886 

98 

1.20 

0.02 

0.00 

-0.04 

3MD610 

A 

1 

57 

53 

1.77 

0.19 

1.68 

0.20 

3MD610 

B 

0 

45 

42 

1.31 

0.12 

1.21 

-0.16 

3MD610 

C 

0 

6 

6 

1.10 

0.41 

1.13 

-0.09 

3MD610 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD611 

* 

-1 

4887 

98 

1.18 

0.02 

0.00 

-0.11 

3MD611 

A 

1 

52 

49 

2.68 

0.22 

2.04 

0.30 

3MD611 

B 

0 

37 

35 

2.24 

0.19 

1.99 

0.01 

3MD611 

C 

0 

18 

17 

0.87 

0.24 

0.53 

-0.41 

3MD611 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD612 

* 

-1 

4774 

96 

1.15 

0.02 

0.00 

-0.19 

3MD612 

A 

1 

91 

41 

2.99 

0.14 

1.26 

0.39 

3MD612 

B 

0 

100 

45 

2.19 

0.09 

1.09 

-0.18 

3MD612 

C 

0 

29 

13 

1.43 

0.19 

0.66 

-0.32 

3MD612 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD62 

* 

-1 

4880 

98 

1.19 

0.02 

0.00 

-0.10 

3MD62 

A 

1 

48 

42 

2.61 

0.18 

1.25 

0.39 

3MD62 

B 

0 

49 

43 

1.90 

0.14 

1.38 

-0.11 

3MD62 

C 

0 

17 

15 

0.93 

0.20 

0.47 

-0.39 

3MD62 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD63 

* 

-1 

4875 

98 

1.19 

0.02 

0.00 

-0.10 

3MD63 

A 

1 

26 

22 

3.10 

0.32 

1.68 

0.45 

3MD63 

B 

0 

77 

65 

1.86 

0.10 

0.97 

-0.21 

3MD63 

C 

0 

16 

13 

1.28 

0.28 

0.62 

-0.25 

3MD63 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD64 

* 

-1 

4870 

98 

1.19 

0.02 

0.00 

-0.08 

3MD64 

A 

1 

102 

82 

2.10 

0.12 

1.04 

0.35 

3MD64 

B 

0 

18 

15 

0.94 

0.24 

1.00 

-0.31 

3MD64 

C 

0 

4 

3 

1.06 

0.30 

0.77 

-0.12 

3MD64 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3MD65 

* 

-1 

4880 

98 

1.19 

0.02 

0.00 

-0.07 

3MD65 

A 

1 

96 

84 

1.97 

0.11 

0.98 

0.35 

3MD65 

B 

0 

12 

11 

1.02 

0.22 

0.85 

-0.24 

3MD65 

C 

0 

6 

5 

0.66 

0.20 

0.50 

-0.24 

3MD65 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD66 

* 

-1 

4871 

98 

1.18 

0.02 

0.00 

-0.12 

3MD66 

A 

1 

113 

92 

2.30 

0.10 

0.97 

0.26 

3MD66 

B 

0 

7 

6 

1.46 

0.31 

0.97 

-0.17 

3MD66 

C 

0 

3 

2 

0.69 

0.99 

0.91 

-0.21 

3MD66 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD67 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.12 

3MD67 

A 

1 

75 

68 

2.58 

0.14 

1.09 

0.33 

3MD67 

B 

0 

20 

18 

1.76 

0.24 

1.20 

-0.21 

3MD67 

C 

0 

16 

14 

1.68 

0.26 

1.20 

-0.21 

3MD67 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD68 

* 

-1 

4888 

98 

1.20 

0.02 

0.00 

-0.04 

3MD68 

A 

1 

83 

78 

1.83 

0.12 

0.98 

0.35 

3MD68 

B 

0 

10 

9 

0.75 

0.46 

2.25 

-0.24 

3MD68 

C 

0 

13 

12 

0.89 

0.26 

1.22 

-0.23 

3MD68 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD69 

* 

-1 

4888 

98 

1.17 

0.02 

0.00 

-0.17 

3MD69 

A 

1 

87 

82 

3.01 

0.12 

0.87 

0.52 

3MD69 

B 

0 

14 

13 

1.18 

0.19 

0.42 

-0.47 

3MD69 

C 

0 

5 

5 

1.71 

0.40 

0.82 

-0.18 

3MD69 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD71 

* 

-1 

4885 

98 

1.18 

0.02 

0.00 

-0.11 

3MD71 

A 

1 

94 

86 

2.33 

0.11 

0.98 

0.34 

3MD71 

B 

0 

4 

4 

1.45 

0.34 

0.84 

-0.12 

3MD71 

C 

0 

11 

10 

1.12 

0.24 

0.68 

-0.31 

3MD71 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3MD710 

* 

-1 

4875 

98 

1.19 

0.02 

0.00 

-0.09 

3MD710 

A 

1 

36 

30 

2.85 

0.23 

1.13 

0.47 

3MD710 

B 

0 

54 

45 

1.54 

0.13 

0.95 

-0.32 

3MD710 

C 

0 

29 

24 

1.70 

0.17 

0.98 

-0.13 

3MD710 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD711 

* 

-1 

4883 

98 

1.19 

0.02 

0.00 

-0.10 

3MD711 

A 

1 

52 

47 

2.55 

0.21 

1.71 

0.32 

3MD711 

B 

0 

31 

28 

1.63 

0.18 

1.00 

-0.22 

3MD711 

C 

0 

28 

25 

1.77 

0.20 

1.17 

-0.14 

3MD711 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD712 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.08 

3MD712 

A 

1 

47 

41 

2.49 

0.17 

1.07 

0.42 

3MD712 

B 

0 

33 

28 

1.47 

0.15 

0.87 

-0.28 

3MD712 

C 

0 

36 

31 

1.67 

0.13 

1.00 

-0.17 

3MD712 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD72 

* 

-1 

4888 

98 

1.19 

0.02 

0.00 

-0.07 

3MD72 

A 

1 

83 

78 

2.03 

0.11 

0.97 

0.41 

3MD72 

B 

0 

12 

11 

0.76 

0.23 

0.58 

-0.35 

3MD72 

C 

0 

11 

10 

1.23 

0.34 

1.24 

-0.18 

3MD72 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD73 

* 

-1 

4880 

98 

1.19 

0.02 

0.00 

-0.10 

3MD73 

A 

1 

100 

88 

2.16 

0.12 

1.07 

0.23 

3MD73 

B 

0 

7 

6 

1.43 

0.37 

1.34 

-0.13 

3MD73 

C 

0 

7 

6 

1.15 

0.37 

1.08 

-0.19 

3MD73 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD74 

* 

-1 

4875 

98 

1.19 

0.02 

0.00 

-0.10 

3MD74 

A 

1 

42 

35 

2.54 

0.24 

1.67 

0.29 

3MD74 

B 

0 

9 

8 

1.15 

0.28 

0.51 

-0.21 

3MD74 

C 

0 

68 

57 

1.87 

0.12 

1.22 

-0.17 

3MD74 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3MD75 

* 

-1 

4871 

98 

1.19 

0.02 

0.00 

-0.08 

3MD75 

A 

1 

84 

68 

2.15 

0.14 

1.17 

0.30 

3MD75 

B 

0 

13 

11 

0.99 

0.34 

1.08 

-0.25 

3MD75 

C 

0 

26 

21 

1.52 

0.20 

1.42 

-0.16 

3MD75 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD76 

* 

-1 

4753 

95 

1.16 

0.02 

0.00 

-0.14 

3MD76 

A 

1 

85 

35 

2.29 

0.17 

2.14 

0.15 

3MD76 

B 

0 

111 

46 

1.98 

0.10 

1.56 

-0.04 

3MD76 

C 

0 

45 

19 

1.69 

0.15 

1.07 

-0.13 

3MD76 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD77 

* 

-1 

4880 

98 

1.19 

0.02 

0.00 

-0.07 

3MD77 

A 

1 

43 

38 

2.38 

0.19 

1.15 

0.41 

3MD77 

B 

0 

27 

24 

1.69 

0.18 

1.21 

-0.05 

3MD77 

C 

0 

44 

39 

1.30 

0.13 

0.77 

-0.36 

3MD77 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD78 

* 

-1 

4872 

98 

1.18 

0.02 

0.00 

-0.12 

3MD78 

A 

1 

44 

36 

2.75 

0.20 

1.66 

0.36 

3MD78 

B 

0 

65 

53 

2.05 

0.10 

1.01 

-0.15 

3MD78 

C 

0 

13 

11 

1.14 

0.21 

0.38 

-0.33 

3MD78 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD79 

* 

-1 

4884 

98 

1.18 

0.02 

0.00 

-0.12 

3MD79 

A 

1 

33 

30 

2.89 

0.26 

1.72 

0.31 

3MD79 

B 

0 

55 

50 

2.26 

0.14 

1.24 

-0.04 

3MD79 

C 

0 

22 

20 

1.56 

0.19 

0.57 

-0.30 

3MD79 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD81 

* 

-1 

4888 

98 

1.20 

0.02 

0.00 

-0.04 

3MD81 

A 

1 

82 

77 

1.82 

0.12 

0.94 

0.32 

3MD81 

B 

0 

14 

13 

0.87 

0.34 

1.54 

-0.25 

3MD81 

C 

0 

10 

9 

0.97 

0.45 

1.93 

-0.17 

3MD81 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3MD810 

* 

-1 

4888 

98 

1.17 

0.02 

0.00 

-0.17 

3MD810 

A 

1 

69 

65 

2.89 

0.15 

1.38 

0.20 

3MD810 

B 

0 

20 

19 

3.15 

0.23 

3.12 

0.17 

3MD810 

C 

0 

17 

16 

1.45 

0.18 

0.47 

-0.44 

3MD810 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD811 

* 

-1 

4885 

98 

1.18 

0.02 

0.00 

-0.11 

3MD811 

A 

1 

77 

71 

2.42 

0.12 

0.96 

0.33 

3MD811 

B 

0 

16 

15 

1.74 

0.33 

1.91 

-0.16 

3MD811 

C 

0 

16 

15 

1.44 

0.24 

0.97 

-0.27 

3MD811 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD812 

* 

-1 

4875 

98 

1.19 

0.02 

0.00 

-0.09 

3MD812 

A 

1 

54 

45 

2.69 

0.17 

0.94 

0.53 

3MD812 

B 

0 

16 

13 

1.32 

0.21 

0.76 

-0.21 

3MD812 

C 

0 

49 

41 

1.40 

0.12 

0.90 

-0.39 

3MD812 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD82 

* 

-1 

4769 

95 

1.17 

0.02 

0.00 

-0.11 

3MD82 

A 

1 

200 

89 

2.02 

0.07 

0.87 

0.41 

3MD82 

B 

0 

9 

4 

0.75 

0.33 

0.72 

-0.22 

3MD82 

C 

0 

16 

7 

0.57 

0.22 

0.56 

-0.34 

3MD82 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD83 

* 

-1 

4884 

98 

1.19 

0.02 

0.00 

-0.10 

3MD83 

A 

1 

83 

75 

2.51 

0.13 

0.79 

0.54 

3MD83 

B 

0 

20 

18 

0.89 

0.26 

1.44 

-0.43 

3MD83 

C 

0 

7 

6 

0.67 

0.22 

0.40 

-0.28 

3MD83 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD84 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.08 

3MD84 

A 

1 

23 

20 

2.52 

0.31 

1.50 

0.27 

3MD84 

B 

0 

35 

30 

1.85 

0.15 

0.98 

-0.06 

3MD84 

C 

0 

58 

50 

1.77 

0.13 

1.07 

-0.16 

3MD84 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3MD85 

* 

-1 

4888 

98 

1.19 

0.02 

0.00 

-0.07 

3MD85 

A 

1 

82 

77 

2.14 

0.10 

0.78 

0.60 

3MD85 

B 

0 

15 

14 

0.80 

0.14 

0.53 

-0.39 

3MD85 

C 

0 

9 

8 

0.34 

0.34 

0.45 

-0.42 

3MD85 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD86 

* 

-1 

4887 

98 

1.20 

0.02 

0.00 

-0.04 

3MD86 

A 

1 

45 

42 

2.05 

0.21 

1.44 

0.36 

3MD86 

B 

0 

28 

26 

1.41 

0.20 

1.55 

-0.06 

3MD86 

C 

0 

34 

32 

0.95 

0.13 

0.74 

-0.33 

3MD86 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD87 

* 

-1 

4887 

98 

1.18 

0.02 

0.00 

-0.11 

3MD87 

A 

1 

78 

73 

2.60 

0.17 

1.16 

0.41 

3MD87 

B 

0 

14 

13 

1.31 

0.29 

1.13 

-0.24 

3MD87 

C 

0 

15 

14 

1.10 

0.30 

0.87 

-0.30 

3MD87 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD88 

* 

-1 

4880 

98 

1.19 

0.02 

0.00 

-0.10 

3MD88 

A 

1 

100 

88 

2.26 

0.12 

0.90 

0.45 

3MD88 

B 

0 

12 

11 

0.63 

0.15 

0.45 

-0.40 

3MD88 

C 

0 

2 

2 

0.29 

0.53 

0.32 

-0.19 

3MD88 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3MD89 

* 

-1 

4876 

98 

1.19 

0.02 

0.00 

-0.10 

3MD89 

A 

1 

62 

53 

2.58 

0.15 

0.93 

0.44 

3MD89 

B 

0 

23 

19 

0.94 

0.20 

0.57 

-0.44 

3MD89 

C 

0 

33 

28 

1.87 

0.17 

1.52 

-0.10 

3MD89 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT11 

* 

-1 

4666 

93 

1.16 

0.02 

0.00 

-0.13 

3NBT11 

A 

1 

265 

81 

2.13 

0.07 

0.93 

0.44 

3NBT11 

B 

0 

38 

12 

0.72 

0.14 

0.74 

-0.32 

3NBT11 

C 

0 

25 

8 

0.64 

0.21 

0.76 

-0.27 

3NBT11 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3NBT110 

* 

-1 

4877 

98 

1.20 

0.02 

0.00 

-0.03 

3NBT110 

A 

1 

77 

66 

1.81 

0.15 

1.41 

0.40 

3NBT110 

B 

0 

35 

30 

0.72 

0.17 

0.92 

-0.36 

3NBT110 

C 

0 

5 

4 

0.68 

0.35 

0.72 

-0.12 

3NBT110 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT111 

* 

-1 

4885 

98 

1.18 

0.02 

0.00 

-0.11 

3NBT111 

A 

1 

87 

80 

2.58 

0.15 

0.84 

0.50 

3NBT111 

B 

0 

16 

15 

0.89 

0.30 

0.96 

-0.36 

3NBT111 

C 

0 

6 

6 

0.22 

0.31 

0.33 

-0.32 

3NBT111 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT112 

* 

-1 

4877 

98 

1.19 

0.02 

0.00 

-0.10 

3NBT112 

A 

1 

81 

69 

2.35 

0.13 

1.02 

0.39 

3NBT112 

B 

0 

22 

19 

1.64 

0.24 

1.68 

-0.16 

3NBT112 

C 

0 

14 

12 

0.85 

0.18 

0.51 

-0.36 

3NBT112 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT113 

* 

-1 

4871 

98 

1.18 

0.02 

0.00 

-0.10 

3NBT113 

A 

1 

96 

78 

2.28 

0.12 

1.00 

0.35 

3NBT113 

B 

0 

16 

13 

1.35 

0.29 

1.19 

-0.22 

3NBT113 

C 

0 

11 

9 

1.04 

0.25 

0.71 

-0.25 

3NBT113 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT114 

* 

-1 

4865 

97 

1.19 

0.02 

0.00 

-0.09 

3NBT114 

A 

1 

83 

64 

2.32 

0.13 

1.08 

0.44 

3NBT114 

B 

0 

32 

25 

1.23 

0.18 

0.99 

-0.32 

3NBT114 

C 

0 

14 

11 

1.05 

0.25 

0.78 

-0.24 

3NBT114 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT115 

* 

-1 

4877 

98 

1.19 

0.02 

0.00 

-0.07 

3NBT115 

A 

1 

82 

70 

2.09 

0.13 

1.06 

0.35 

3NBT115 

B 

0 

22 

19 

1.18 

0.19 

1.01 

-0.26 

3NBT115 

C 

0 

13 

11 

1.21 

0.20 

0.87 

-0.19 

3NBT115 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3NBT116 

* 

-1 

4863 

97 

1.18 

0.02 

0.00 

-0.12 

3NBT116 

A 

1 

96 

73 

2.41 

0.12 

1.21 

0.29 

3NBT116 

B 

0 

29 

22 

1.75 

0.16 

1.13 

-0.22 

3NBT116 

C 

0 

6 

5 

1.32 

0.28 

0.67 

-0.17 

3NBT116 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT117 

* 

-1 

4881 

98 

1.18 

0.02 

0.00 

-0.12 

3NBT117 

A 

1 

81 

72 

2.62 

0.14 

1.06 

0.40 

3NBT117 

B 

0 

17 

15 

1.69 

0.17 

0.89 

-0.21 

3NBT117 

C 

0 

15 

13 

1.31 

0.28 

0.93 

-0.31 

3NBT117 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT118 

* 

-1 

4886 

98 

1.20 

0.02 

0.00 

-0.05 

3NBT118 

A 

1 

76 

70 

2.07 

0.14 

1.01 

0.51 

3NBT118 

B 

0 

15 

14 

0.59 

0.14 

0.52 

-0.35 

3NBT118 

C 

0 

17 

16 

0.80 

0.20 

0.81 

-0.30 

3NBT118 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT119 

* 

-1 

4885 

98 

1.17 

0.02 

0.00 

-0.16 

3NBT119 

A 

1 

77 

71 

3.08 

0.14 

0.98 

0.49 

3NBT119 

B 

0 

16 

15 

1.72 

0.23 

0.73 

-0.32 

3NBT119 

C 

0 

16 

15 

1.73 

0.20 

0.70 

-0.32 

3NBT119 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT12 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.11 

3NBT12 

A 

1 

85 

77 

2.44 

0.12 

0.90 

0.45 

3NBT12 

B 

0 

19 

17 

1.30 

0.13 

0.65 

-0.35 

3NBT12 

C 

0 

7 

6 

1.08 

0.46 

0.78 

-0.25 

3NBT12 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT120 

* 

-1 

4865 

97 

1.19 

0.02 

0.00 

-0.09 

3NBT120 

A 

1 

60 

47 

2.52 

0.17 

1.01 

0.42 

3NBT120 

B 

0 

40 

31 

1.58 

0.15 

1.23 

-0.19 

3NBT120 

C 

0 

29 

22 

1.26 

0.20 

0.94 

-0.29 

3NBT120 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

easyCBM  CCSS  Third  Grade  Math  Measure  Development 


457 

Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3NBT121 

* 

-1 

4876 

98 

1.18 

0.02 

0.00 

-0.11 

3NBT121 

A 

1 

85 

72 

2.36 

0.15 

1.28 

0.29 

3NBT121 

B 

0 

22 

19 

1.69 

0.24 

1.97 

-0.15 

3NBT121 

C 

0 

11 

9 

1.10 

0.25 

0.68 

-0.25 

3NBT121 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT122 

* 

-1 

4875 

98 

1.19 

0.02 

0.00 

-0.08 

3NBT122 

A 

1 

81 

68 

2.26 

0.12 

0.91 

0.46 

3NBT122 

B 

0 

21 

18 

1.14 

0.17 

0.77 

-0.33 

3NBT122 

C 

0 

17 

14 

1.26 

0.18 

0.83 

-0.25 

3NBT122 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT123 

* 

-1 

4879 

98 

1.19 

0.02 

0.00 

-0.07 

3NBT123 

A 

1 

96 

83 

1.96 

0.11 

1.21 

0.27 

3NBT123 

B 

0 

10 

9 

1.36 

0.22 

1.19 

-0.14 

3NBT123 

C 

0 

9 

8 

1.06 

0.31 

0.97 

-0.22 

3NBT123 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT124 

* 

-1 

4884 

98 

1.20 

0.02 

0.00 

-0.04 

3NBT124 

A 

1 

80 

73 

1.80 

0.14 

1.09 

0.33 

3NBT124 

B 

0 

14 

13 

1.05 

0.24 

1.16 

-0.16 

3NBT124 

C 

0 

16 

15 

0.78 

0.21 

0.85 

-0.27 

3NBT124 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT125 

* 

-1 

4759 

95 

1.16 

0.02 

0.00 

-0.14 

3NBT125 

A 

1 

160 

68 

2.43 

0.09 

0.91 

0.46 

3NBT125 

B 

0 

29 

12 

1.18 

0.17 

0.81 

-0.28 

3NBT125 

C 

0 

46 

20 

1.31 

0.11 

0.82 

-0.31 

3NBT125 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT126 

* 

-1 

4887 

98 

1.18 

0.02 

0.00 

-0.11 

3NBT126 

A 

1 

84 

79 

2.58 

0.16 

1.01 

0.45 

3NBT126 

B 

0 

10 

9 

1.50 

0.34 

1.27 

-0.15 

3NBT126 

C 

0 

13 

12 

0.47 

0.23 

0.44 

-0.43 

3NBT126 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3NBT127 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.10 

3NBT127 

A 

1 

77 

66 

2.35 

0.14 

1.14 

0.35 

3NBT127 

B 

0 

4 

3 

1.28 

0.39 

0.71 

-0.12 

3NBT127 

C 

0 

35 

30 

1.45 

0.16 

1.17 

-0.32 

3NBT127 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT128 

* 

-1 

4874 

98 

1.18 

0.02 

0.00 

-0.10 

3NBT128 

A 

1 

99 

83 

2.24 

0.12 

0.92 

0.33 

3NBT128 

B 

0 

4 

3 

0.32 

0.54 

0.44 

-0.26 

3NBT128 

C 

0 

17 

14 

1.35 

0.31 

1.82 

-0.23 

3NBT128 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT129 

* 

-1 

4867 

97 

1.19 

0.02 

0.00 

-0.08 

3NBT129 

A 

1 

60 

47 

2.39 

0.17 

1.43 

0.37 

3NBT129 

B 

0 

19 

15 

1.37 

0.22 

0.84 

-0.18 

3NBT129 

C 

0 

48 

38 

1.51 

0.15 

1.08 

-0.25 

3NBT129 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT13 

* 

-1 

4877 

98 

1.19 

0.02 

0.00 

-0.07 

3NBT13 

A 

1 

91 

78 

2.11 

0.12 

0.90 

0.47 

3NBT13 

B 

0 

9 

8 

0.90 

0.26 

0.72 

-0.23 

3NBT13 

C 

0 

17 

15 

0.73 

0.13 

0.55 

-0.39 

3NBT13 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT130 

* 

-1 

4869 

97 

1.18 

0.02 

0.00 

-0.12 

3NBT130 

A 

1 

106 

85 

2.41 

0.10 

0.93 

0.44 

3NBT130 

B 

0 

13 

10 

1.24 

0.19 

0.67 

-0.29 

3NBT130 

C 

0 

6 

5 

0.66 

0.33 

0.39 

-0.31 

3NBT130 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT131 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.12 

3NBT131 

A 

1 

87 

78 

2.44 

0.13 

1.13 

0.21 

3NBT131 

B 

0 

12 

11 

1.81 

0.28 

1.29 

-0.14 

3NBT131 

C 

0 

12 

11 

1.82 

0.42 

2.79 

-0.14 

3NBT131 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

easyCBM  CCSS  Third  Grade  Math  Measure  Development 


459 

Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3NBT132 

* 

-1 

4888 

98 

1.20 

0.02 

0.00 

-0.04 

3NBT132 

A 

1 

65 

61 

2.12 

0.14 

0.93 

0.54 

3NBT132 

B 

0 

14 

13 

0.84 

0.26 

0.81 

-0.25 

3NBT132 

C 

0 

27 

25 

0.79 

0.13 

0.62 

-0.41 

3NBT132 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT133 

* 

-1 

4885 

98 

1.17 

0.02 

0.00 

-0.16 

3NBT133 

A 

1 

68 

62 

3.04 

0.15 

1.25 

0.36 

3NBT133 

B 

0 

16 

15 

1.88 

0.20 

0.73 

-0.26 

3NBT133 

C 

0 

25 

23 

2.24 

0.23 

1.62 

-0.19 

3NBT133 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT134 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.11 

3NBT134 

A 

1 

76 

68 

2.45 

0.13 

1.00 

0.39 

3NBT134 

B 

0 

20 

18 

1.55 

0.19 

0.99 

-0.25 

3NBT134 

C 

0 

15 

14 

1.48 

0.24 

0.89 

-0.24 

3NBT134 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT14 

* 

-1 

4872 

98 

1.19 

0.02 

0.00 

-0.09 

3NBT14 

A 

1 

66 

54 

2.49 

0.16 

0.97 

0.47 

3NBT14 

B 

0 

35 

29 

1.27 

0.13 

0.80 

-0.36 

3NBT14 

C 

0 

21 

17 

1.44 

0.19 

1.01 

-0.19 

3NBT14 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT15 

* 

-1 

4879 

98 

1.18 

0.02 

0.00 

-0.11 

3NBT15 

A 

1 

92 

80 

2.36 

0.14 

1.06 

0.35 

3NBT15 

B 

0 

11 

10 

1.22 

0.36 

1.48 

-0.22 

3NBT15 

C 

0 

12 

10 

1.17 

0.27 

0.85 

-0.25 

3NBT15 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT16 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.08 

3NBT16 

A 

1 

85 

73 

2.23 

0.11 

0.94 

0.44 

3NBT16 

B 

0 

22 

19 

1.26 

0.15 

0.86 

-0.31 

3NBT16 

C 

0 

9 

8 

0.88 

0.22 

0.56 

-0.29 

3NBT16 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

easyCBM  CCSS  Third  Grade  Math  Measure  Development 


460 

Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3NBT17 

* 

-1 

4886 

98 

1.19 

0.02 

0.00 

-0.07 

3NBT17 

A 

1 

70 

65 

2.10 

0.12 

1.15 

0.38 

3NBT17 

B 

0 

32 

30 

1.40 

0.15 

1.05 

-0.25 

3NBT17 

C 

0 

6 

6 

0.50 

0.32 

0.37 

-0.30 

3NBT17 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT18 

* 

-1 

4884 

98 

1.20 

0.02 

0.00 

-0.04 

3NBT18 

A 

1 

77 

70 

1.91 

0.13 

0.98 

0.45 

3NBT18 

B 

0 

25 

23 

0.83 

0.17 

0.89 

-0.33 

3NBT18 

C 

0 

8 

7 

0.45 

0.26 

0.56 

-0.26 

3NBT18 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT19 

* 

-1 

4887 

98 

1.18 

0.02 

0.00 

-0.11 

3NBT19 

A 

1 

89 

83 

2.53 

0.15 

0.98 

0.45 

3NBT19 

B 

0 

13 

12 

0.78 

0.28 

0.74 

-0.36 

3NBT19 

C 

0 

5 

5 

0.60 

0.45 

0.57 

-0.24 

3NBT19 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT21 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.10 

3NBT21 

A 

1 

103 

89 

2.18 

0.12 

0.99 

0.32 

3NBT21 

B 

0 

3 

3 

1.33 

0.20 

0.83 

-0.10 

3NBT21 

C 

0 

10 

9 

0.83 

0.28 

0.72 

-0.31 

3NBT21 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT210 

* 

-1 

4874 

98 

1.18 

0.02 

0.00 

-0.10 

3NBT210 

A 

1 

99 

83 

2.25 

0.12 

0.96 

0.34 

3NBT210 

B 

0 

14 

12 

1.18 

0.33 

1.45 

-0.25 

3NBT210 

C 

0 

7 

6 

1.02 

0.40 

0.91 

-0.21 

3NBT210 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT211 

* 

-1 

4869 

97 

1.19 

0.02 

0.00 

-0.08 

3NBT211 

A 

1 

63 

50 

2.35 

0.15 

1.12 

0.36 

3NBT211 

B 

0 

40 

32 

1.29 

0.18 

0.95 

-0.34 

3NBT211 

C 

0 

22 

18 

1.75 

0.25 

1.72 

-0.06 

3NBT211 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3NBT212 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.07 

3NBT212 

A 

1 

82 

71 

2.13 

0.13 

1.00 

0.41 

3NBT212 

B 

0 

28 

24 

0.96 

0.13 

0.71 

-0.41 

3NBT212 

C 

0 

6 

5 

1.61 

0.34 

1.48 

-0.04 

3NBT212 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT213 

* 

-1 

4871 

98 

1.18 

0.02 

0.00 

-0.12 

3NBT213 

A 

1 

81 

66 

2.57 

0.12 

1.08 

0.45 

3NBT213 

B 

0 

27 

22 

1.58 

0.16 

0.91 

-0.30 

3NBT213 

C 

0 

15 

12 

1.40 

0.20 

0.66 

-0.27 

3NBT213 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT214 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.12 

3NBT214 

A 

1 

85 

77 

2.57 

0.13 

1.05 

0.39 

3NBT214 

B 

0 

10 

9 

1.42 

0.39 

1.26 

-0.23 

3NBT214 

C 

0 

16 

14 

1.45 

0.17 

0.75 

-0.29 

3NBT214 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT215 

* 

-1 

4888 

98 

1.20 

0.02 

0.00 

-0.04 

3NBT215 

A 

1 

60 

57 

2.04 

0.14 

1.06 

0.41 

3NBT215 

B 

0 

32 

30 

1.27 

0.21 

1.87 

-0.19 

3NBT215 

C 

0 

14 

13 

0.59 

0.22 

0.55 

-0.34 

3NBT215 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT216 

* 

-1 

4887 

98 

1.17 

0.02 

0.00 

-0.16 

3NBT216 

A 

1 

66 

62 

3.11 

0.14 

0.99 

0.41 

3NBT216 

B 

0 

18 

17 

2.26 

0.34 

1.79 

-0.15 

3NBT216 

C 

0 

23 

21 

1.85 

0.19 

0.79 

-0.35 

3NBT216 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT217 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.11 

3NBT217 

A 

1 

75 

68 

2.52 

0.12 

0.87 

0.46 

3NBT217 

B 

0 

24 

22 

1.26 

0.16 

0.67 

-0.42 

3NBT217 

C 

0 

12 

11 

1.72 

0.29 

1.21 

-0.14 

3NBT217 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3NBT218 

* 

-1 

4873 

98 

1.19 

0.02 

0.00 

-0.09 

3NBT218 

A 

1 

62 

51 

2.62 

0.16 

0.95 

0.55 

3NBT218 

B 

0 

39 

32 

1.14 

0.10 

0.59 

-0.47 

3NBT218 

C 

0 

20 

17 

1.59 

0.16 

0.99 

-0.14 

3NBT218 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT219 

* 

-1 

4880 

98 

1.18 

0.02 

0.00 

-0.11 

3NBT219 

A 

1 

67 

59 

2.60 

0.17 

1.38 

0.42 

3NBT219 

B 

0 

24 

21 

1.35 

0.16 

0.73 

-0.30 

3NBT219 

C 

0 

23 

20 

1.56 

0.22 

1.12 

-0.21 

3NBT219 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT22 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.08 

3NBT22 

A 

1 

72 

62 

2.16 

0.12 

1.07 

0.26 

3NBT22 

B 

0 

28 

24 

1.77 

0.19 

2.01 

-0.09 

3NBT22 

C 

0 

16 

14 

1.25 

0.26 

1.08 

-0.26 

3NBT22 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT220 

* 

-1 

4887 

98 

1.19 

0.02 

0.00 

-0.07 

3NBT220 

A 

1 

74 

69 

2.06 

0.11 

1.09 

0.37 

3NBT220 

B 

0 

20 

19 

1.21 

0.22 

0.96 

-0.27 

3NBT220 

C 

0 

13 

12 

1.25 

0.31 

1.28 

-0.20 

3NBT220 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT221 

* 

-1 

4886 

98 

1.20 

0.02 

0.00 

-0.04 

3NBT221 

A 

1 

61 

56 

2.08 

0.15 

0.89 

0.50 

3NBT221 

B 

0 

31 

29 

0.72 

0.15 

0.74 

-0.43 

3NBT221 

C 

0 

16 

15 

1.10 

0.26 

1.22 

-0.15 

3NBT221 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT222 

* 

-1 

4887 

98 

1.18 

0.02 

0.00 

-0.11 

3NBT222 

A 

1 

85 

79 

2.60 

0.15 

0.94 

0.49 

3NBT222 

B 

0 

10 

9 

1.09 

0.45 

1.86 

-0.24 

3NBT222 

C 

0 

12 

11 

0.51 

0.23 

0.44 

-0.40 

3NBT222 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3NBT223 

* 

-1 

4880 

98 

1.19 

0.02 

0.00 

-0.10 

3NBT223 

A 

1 

86 

75 

2.34 

0.13 

1.03 

0.41 

3NBT223 

B 

0 

20 

18 

1.30 

0.16 

0.84 

-0.28 

3NBT223 

C 

0 

8 

7 

0.85 

0.35 

0.69 

-0.27 

3NBT223 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT224 

* 

-1 

4875 

98 

1.19 

0.02 

0.00 

-0.10 

3NBT224 

A 

1 

115 

97 

2.12 

0.11 

0.93 

0.29 

3NBT224 

B 

0 

2 

2 

0.62 

0.35 

0.47 

-0.15 

3NBT224 

C 

0 

2 

2 

-0.45 

0.00 

0.15 

-0.26 

3NBT224 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT225 

* 

-1 

4870 

98 

1.19 

0.02 

0.00 

-0.08 

3NBT225 

A 

1 

91 

73 

2.15 

0.13 

1.10 

0.33 

3NBT225 

B 

0 

17 

14 

1.54 

0.25 

1.55 

-0.11 

3NBT225 

C 

0 

16 

13 

0.86 

0.25 

0.75 

-0.32 

3NBT225 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT226 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.07 

3NBT226 

A 

1 

72 

62 

2.23 

0.13 

0.93 

0.45 

3NBT226 

B 

0 

25 

22 

1.42 

0.19 

1.23 

-0.18 

3NBT226 

C 

0 

19 

16 

0.79 

0.14 

0.52 

-0.39 

3NBT226 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT227 

* 

-1 

4778 

96 

1.16 

0.02 

0.00 

-0.15 

3NBT227 

A 

1 

207 

96 

2.24 

0.09 

1.01 

0.24 

3NBT227 

B 

0 

4 

2 

0.98 

0.42 

0.78 

-0.12 

3NBT227 

C 

0 

5 

2 

0.36 

0.24 

0.38 

-0.21 

3NBT227 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT228 

* 

-1 

4871 

98 

1.18 

0.02 

0.00 

-0.12 

3NBT228 

A 

1 

66 

54 

2.55 

0.15 

1.42 

0.32 

3NBT228 

B 

0 

55 

45 

1.88 

0.12 

1.15 

-0.27 

3NBT228 

C 

0 

2 

2 

0.43 

0.00 

0.18 

-0.20 

3NBT228 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3NBT229 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.12 

3NBT229 

A 

1 

93 

84 

2.53 

0.12 

0.92 

0.41 

3NBT229 

B 

0 

11 

10 

1.21 

0.25 

0.72 

-0.30 

3NBT229 

C 

0 

7 

6 

1.06 

0.42 

0.76 

-0.26 

3NBT229 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT23 

* 

-1 

4888 

98 

1.20 

0.02 

0.00 

-0.04 

3NBT23 

A 

1 

69 

65 

2.01 

0.13 

0.87 

0.46 

3NBT23 

B 

0 

33 

31 

0.96 

0.19 

1.40 

-0.37 

3NBT23 

C 

0 

4 

4 

0.12 

0.37 

0.34 

-0.25 

3NBT23 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT230 

* 

-1 

4888 

98 

1.17 

0.02 

0.00 

-0.17 

3NBT230 

A 

1 

87 

82 

2.94 

0.13 

0.95 

0.39 

3NBT230 

B 

0 

11 

10 

1.68 

0.29 

0.84 

-0.28 

3NBT230 

C 

0 

8 

8 

1.61 

0.42 

0.86 

-0.25 

3NBT230 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT231 

* 

-1 

4884 

98 

1.18 

0.02 

0.00 

-0.11 

3NBT231 

A 

1 

57 

52 

2.62 

0.15 

1.12 

0.42 

3NBT231 

B 

0 

44 

40 

1.76 

0.14 

1.07 

-0.30 

3NBT231 

C 

0 

9 

8 

1.33 

0.18 

0.52 

-0.22 

3NBT231 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT232 

* 

-1 

4873 

98 

1.19 

0.02 

0.00 

-0.09 

3NBT232 

A 

1 

81 

67 

2.41 

0.13 

0.91 

0.51 

3NBT232 

B 

0 

29 

24 

1.11 

0.11 

0.65 

-0.40 

3NBT232 

C 

0 

11 

9 

1.02 

0.23 

0.65 

-0.25 

3NBT232 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT233 

* 

-1 

4756 

95 

1.16 

0.02 

0.00 

-0.14 

3NBT233 

A 

1 

184 

77 

2.32 

0.09 

1.00 

0.41 

3NBT233 

B 

0 

41 

17 

1.03 

0.13 

0.72 

-0.38 

3NBT233 

C 

0 

13 

5 

1.43 

0.22 

1.03 

-0.12 

3NBT233 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3NBT24 

* 

-1 

4880 

98 

1.18 

0.02 

0.00 

-0.11 

3NBT24 

A 

1 

98 

86 

2.33 

0.13 

0.92 

0.38 

3NBT24 

B 

0 

11 

10 

1.35 

0.30 

1.31 

-0.19 

3NBT24 

C 

0 

5 

4 

-0.19 

0.23 

0.19 

-0.37 

3NBT24 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT25 

* 

-1 

4760 

95 

1.17 

0.02 

0.00 

-0.13 

3NBT25 

A 

1 

223 

95 

2.09 

0.08 

0.95 

0.26 

3NBT25 

B 

0 

4 

2 

-0.11 

0.24 

0.23 

-0.23 

3NBT25 

C 

0 

7 

3 

1.00 

0.36 

0.92 

-0.15 

3NBT25 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT26 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.08 

3NBT26 

A 

1 

90 

78 

2.07 

0.11 

1.03 

0.22 

3NBT26 

B 

0 

16 

14 

1.56 

0.23 

1.48 

-0.14 

3NBT26 

C 

0 

10 

9 

1.39 

0.49 

3.48 

-0.16 

3NBT26 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT27 

* 

-1 

4887 

98 

1.19 

0.02 

0.00 

-0.07 

3NBT27 

A 

1 

88 

82 

1.93 

0.11 

1.08 

0.25 

3NBT27 

B 

0 

13 

12 

1.35 

0.31 

1.36 

-0.16 

3NBT27 

C 

0 

6 

6 

1.01 

0.53 

1.22 

-0.18 

3NBT27 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT28 

* 

-1 

4886 

98 

1.20 

0.02 

0.00 

-0.04 

3NBT28 

A 

1 

96 

89 

1.63 

0.12 

0.98 

0.20 

3NBT28 

B 

0 

9 

8 

0.96 

0.49 

2.24 

-0.15 

3NBT28 

C 

0 

3 

3 

0.51 

0.54 

0.78 

-0.14 

3NBT28 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT29 

* 

-1 

4887 

98 

1.18 

0.02 

0.00 

-0.11 

3NBT29 

A 

1 

93 

87 

2.47 

0.15 

1.02 

0.42 

3NBT29 

B 

0 

2 

2 

0.15 

0.68 

0.33 

-0.19 

3NBT29 

C 

0 

12 

11 

0.67 

0.27 

0.74 

-0.37 

3NBT29 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

easyCBM  CCSS  Third  Grade  Math  Measure  Development 


466 

Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3NBT31 

* 

-1 

4880 

98 

1.19 

0.02 

0.00 

-0.10 

3NBT31 

A 

1 

109 

96 

2.11 

0.12 

1.01 

0.20 

3NBT31 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT31 

C 

0 

5 

4 

0.89 

0.27 

0.64 

-0.20 

3NBT31 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT310 

* 

-1 

4875 

98 

1.19 

0.02 

0.00 

-0.10 

3NBT310 

A 

1 

85 

71 

2.28 

0.14 

1.15 

0.29 

3NBT310 

B 

0 

20 

17 

1.60 

0.19 

1.13 

-0.16 

3NBT310 

C 

0 

14 

12 

1.33 

0.30 

1.00 

-0.21 

3NBT310 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT311 

* 

-1 

4870 

98 

1.19 

0.02 

0.00 

-0.08 

3NBT311 

A 

1 

63 

51 

2.40 

0.15 

1.20 

0.40 

3NBT311 

B 

0 

36 

29 

1.32 

0.17 

1.01 

-0.29 

3NBT311 

C 

0 

25 

20 

1.48 

0.25 

1.48 

-0.17 

3NBT311 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT312 

* 

-1 

4880 

98 

1.19 

0.02 

0.00 

-0.07 

3NBT312 

A 

1 

64 

56 

2.14 

0.14 

1.09 

0.35 

3NBT312 

B 

0 

32 

28 

1.49 

0.17 

1.27 

-0.17 

3NBT312 

C 

0 

18 

16 

1.14 

0.20 

0.77 

-0.26 

3NBT312 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT313 

* 

-1 

4871 

98 

1.18 

0.02 

0.00 

-0.12 

3NBT313 

A 

1 

88 

72 

2.51 

0.11 

0.95 

0.42 

3NBT313 

B 

0 

18 

15 

1.64 

0.31 

1.73 

-0.21 

3NBT313 

C 

0 

17 

14 

1.30 

0.18 

0.64 

-0.33 

3NBT313 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT314 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.12 

3NBT314 

A 

1 

74 

67 

2.73 

0.13 

0.89 

0.49 

3NBT314 

B 

0 

8 

7 

1.59 

0.38 

0.99 

-0.16 

3NBT314 

C 

0 

29 

26 

1.41 

0.17 

0.79 

-0.43 

3NBT314 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3NBT315 

* 

-1 

4888 

98 

1.20 

0.02 

0.00 

-0.04 

3NBT315 

A 

1 

71 

67 

2.00 

0.13 

0.93 

0.46 

3NBT315 

B 

0 

11 

10 

0.81 

0.37 

1.01 

-0.23 

3NBT315 

C 

0 

24 

23 

0.85 

0.16 

0.78 

-0.35 

3NBT315 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT316 

* 

-1 

4888 

98 

1.17 

0.02 

0.00 

-0.17 

3NBT316 

A 

1 

53 

50 

3.07 

0.19 

1.45 

0.28 

3NBT316 

B 

0 

35 

33 

2.55 

0.17 

1.35 

-0.09 

3NBT316 

C 

0 

18 

17 

1.96 

0.25 

0.81 

-0.27 

3NBT316 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT317 

* 

-1 

4885 

98 

1.18 

0.02 

0.00 

-0.11 

3NBT317 

A 

1 

83 

76 

2.43 

0.12 

1.01 

0.40 

3NBT317 

B 

0 

16 

15 

1.32 

0.17 

0.70 

-0.31 

3NBT317 

C 

0 

10 

9 

1.42 

0.27 

0.86 

-0.21 

3NBT317 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT318 

* 

-1 

4875 

98 

1.19 

0.02 

0.00 

-0.09 

3NBT318 

A 

1 

64 

54 

2.64 

0.15 

0.81 

0.59 

3NBT318 

B 

0 

44 

37 

1.10 

0.09 

0.57 

-0.54 

3NBT318 

C 

0 

11 

9 

1.58 

0.28 

1.11 

-0.10 

3NBT318 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT319 

* 

-1 

4750 

95 

1.17 

0.02 

0.00 

-0.11 

3NBT319 

A 

1 

198 

81 

2.12 

0.08 

0.90 

0.44 

3NBT319 

B 

0 

17 

7 

0.76 

0.21 

0.76 

-0.25 

3NBT319 

C 

0 

29 

12 

0.76 

0.16 

0.80 

-0.34 

3NBT319 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT32 

* 

-1 

4883 

98 

1.19 

0.02 

0.00 

-0.10 

3NBT32 

A 

1 

89 

80 

2.42 

0.13 

0.89 

0.49 

3NBT32 

B 

0 

9 

8 

0.57 

0.26 

0.44 

-0.34 

3NBT32 

C 

0 

13 

12 

0.94 

0.24 

0.67 

-0.32 

3NBT32 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3NBT320 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.08 

3NBT320 

A 

1 

89 

77 

2.24 

0.11 

0.84 

0.50 

3NBT320 

B 

0 

24 

21 

0.93 

0.15 

0.65 

-0.48 

3NBT320 

C 

0 

3 

3 

1.20 

0.11 

0.63 

-0.11 

3NBT320 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT321 

* 

-1 

4888 

98 

1.19 

0.02 

0.00 

-0.07 

3NBT321 

A 

1 

83 

78 

2.04 

0.11 

1.13 

0.44 

3NBT321 

B 

0 

20 

19 

0.89 

0.15 

0.64 

-0.42 

3NBT321 

C 

0 

3 

3 

1.13 

0.10 

0.67 

-0.11 

3NBT321 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT322 

* 

-1 

4887 

98 

1.20 

0.02 

0.00 

-0.04 

3NBT322 

A 

1 

79 

74 

1.90 

0.13 

0.87 

0.51 

3NBT322 

B 

0 

22 

21 

0.42 

0.16 

0.58 

-0.47 

3NBT322 

C 

0 

6 

6 

0.78 

0.19 

0.71 

-0.15 

3NBT322 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT323 

* 

-1 

4887 

98 

1.18 

0.02 

0.00 

-0.11 

3NBT323 

A 

1 

78 

73 

2.76 

0.15 

0.84 

0.58 

3NBT323 

B 

0 

15 

14 

0.64 

0.21 

0.44 

-0.42 

3NBT323 

C 

0 

14 

13 

0.93 

0.28 

0.75 

-0.33 

3NBT323 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT324 

* 

-1 

4880 

98 

1.19 

0.02 

0.00 

-0.10 

3NBT324 

A 

1 

84 

74 

2.44 

0.12 

0.82 

0.53 

3NBT324 

B 

0 

21 

18 

0.86 

0.16 

0.55 

-0.47 

3NBT324 

C 

0 

9 

8 

1.24 

0.32 

0.88 

-0.20 

3NBT324 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT325 

* 

-1 

4875 

98 

1.19 

0.02 

0.00 

-0.10 

3NBT325 

A 

1 

81 

68 

2.41 

0.14 

1.09 

0.41 

3NBT325 

B 

0 

16 

13 

1.35 

0.24 

0.93 

-0.22 

3NBT325 

C 

0 

22 

18 

1.26 

0.17 

0.78 

-0.30 

3NBT325 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3NBT326 

* 

-1 

4872 

98 

1.19 

0.02 

0.00 

-0.08 

3NBT326 

A 

1 

96 

79 

2.25 

0.12 

0.90 

0.53 

3NBT326 

B 

0 

5 

4 

0.60 

0.21 

0.44 

-0.21 

3NBT326 

C 

0 

21 

17 

0.62 

0.16 

0.53 

-0.46 

3NBT326 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT327 

* 

-1 

4880 

98 

1.19 

0.02 

0.00 

-0.07 

3NBT327 

A 

1 

83 

73 

2.10 

0.12 

0.95 

0.45 

3NBT327 

B 

0 

8 

7 

0.41 

0.16 

0.36 

-0.34 

3NBT327 

C 

0 

23 

20 

1.19 

0.14 

0.87 

-0.28 

3NBT327 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT328 

* 

-1 

4872 

98 

1.18 

0.02 

0.00 

-0.12 

3NBT328 

A 

1 

103 

84 

2.43 

0.10 

0.89 

0.46 

3NBT328 

B 

0 

4 

3 

1.54 

0.52 

0.99 

-0.11 

3NBT328 

C 

0 

15 

12 

0.87 

0.18 

0.46 

-0.45 

3NBT328 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT329 

* 

-1 

4884 

98 

1.18 

0.02 

0.00 

-0.12 

3NBT329 

A 

1 

89 

81 

2.56 

0.13 

0.97 

0.41 

3NBT329 

B 

0 

11 

10 

1.29 

0.30 

0.83 

-0.28 

3NBT329 

C 

0 

10 

9 

1.23 

0.22 

0.63 

-0.28 

3NBT329 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT33 

* 

-1 

4888 

98 

1.20 

0.02 

0.00 

-0.04 

3NBT33 

A 

1 

80 

75 

1.93 

0.12 

0.90 

0.47 

3NBT33 

B 

0 

12 

11 

0.63 

0.30 

0.76 

-0.30 

3NBT33 

C 

0 

14 

13 

0.64 

0.17 

0.63 

-0.32 

3NBT33 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT330 

* 

-1 

4888 

98 

1.17 

0.02 

0.00 

-0.17 

3NBT330 

A 

1 

84 

79 

2.99 

0.13 

0.96 

0.44 

3NBT330 

B 

0 

5 

5 

2.30 

0.34 

1.33 

-0.07 

3NBT330 

C 

0 

17 

16 

1.43 

0.22 

0.59 

-0.44 

3NBT330 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3NBT331 

* 

-1 

4885 

98 

1.18 

0.02 

0.00 

-0.11 

3NBT331 

A 

1 

88 

81 

2.43 

0.11 

0.88 

0.46 

3NBT331 

B 

0 

9 

8 

1.08 

0.26 

0.59 

-0.29 

3NBT331 

C 

0 

12 

11 

1.12 

0.20 

0.59 

-0.33 

3NBT331 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT332 

* 

-1 

4875 

98 

1.19 

0.02 

0.00 

-0.09 

3NBT332 

A 

1 

67 

56 

2.62 

0.14 

0.79 

0.59 

3NBT332 

B 

0 

6 

5 

1.47 

0.32 

0.95 

-0.10 

3NBT332 

C 

0 

46 

39 

1.11 

0.10 

0.61 

-0.56 

3NBT332 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT333 

* 

-1 

4884 

98 

1.19 

0.02 

0.00 

-0.10 

3NBT333 

A 

1 

93 

85 

2.39 

0.13 

0.83 

0.50 

3NBT333 

B 

0 

6 

5 

0.02 

0.32 

0.29 

-0.37 

3NBT333 

C 

0 

11 

10 

0.82 

0.19 

0.57 

-0.32 

3NBT333 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT34 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.08 

3NBT34 

A 

1 

87 

75 

2.25 

0.11 

0.88 

0.49 

3NBT34 

B 

0 

7 

6 

1.22 

0.30 

0.83 

-0.17 

3NBT34 

C 

0 

22 

19 

0.96 

0.14 

0.63 

-0.44 

3NBT34 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT35 

* 

-1 

4888 

98 

1.19 

0.02 

0.00 

-0.07 

3NBT35 

A 

1 

82 

77 

2.09 

0.10 

0.89 

0.51 

3NBT35 

B 

0 

5 

5 

0.32 

0.56 

0.47 

-0.31 

3NBT35 

C 

0 

19 

18 

0.94 

0.16 

0.67 

-0.38 

3NBT35 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT36 

* 

-1 

4872 

98 

1.19 

0.02 

0.00 

-0.08 

3NBT36 

A 

1 

98 

80 

2.19 

0.12 

0.91 

0.47 

3NBT36 

B 

0 

10 

8 

0.63 

0.26 

0.59 

-0.30 

3NBT36 

C 

0 

14 

11 

0.77 

0.24 

0.68 

-0.32 

3NBT36 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3NBT37 

* 

-1 

4880 

98 

1.19 

0.02 

0.00 

-0.07 

3NBT37 

A 

1 

77 

68 

2.19 

0.12 

0.91 

0.51 

3NBT37 

B 

0 

10 

9 

0.75 

0.21 

0.52 

-0.29 

3NBT37 

C 

0 

27 

24 

1.07 

0.13 

0.73 

-0.37 

3NBT37 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT38 

* 

-1 

4754 

95 

1.15 

0.02 

0.00 

-0.18 

3NBT38 

A 

1 

215 

90 

2.39 

0.08 

0.98 

0.32 

3NBT38 

B 

0 

5 

2 

1.42 

0.36 

0.86 

-0.11 

3NBT38 

C 

0 

20 

8 

1.10 

0.19 

0.70 

-0.30 

3NBT38 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NBT39 

* 

-1 

4872 

98 

1.18 

0.02 

0.00 

-0.12 

3NBT39 

A 

1 

74 

61 

2.48 

0.13 

1.15 

0.31 

3NBT39 

B 

0 

33 

27 

1.71 

0.18 

1.14 

-0.27 

3NBT39 

C 

0 

15 

12 

1.93 

0.24 

1.17 

-0.09 

3NBT39 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF21 

* 

-1 

4877 

98 

1.20 

0.02 

0.00 

-0.03 

3NF21 

A 

1 

89 

76 

1.80 

0.12 

0.86 

0.50 

3NF21 

B 

0 

17 

15 

0.29 

0.31 

0.83 

-0.37 

3NF21 

C 

0 

11 

9 

0.30 

0.23 

0.60 

-0.28 

3NF21 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF210 

* 

-1 

4885 

98 

1.18 

0.02 

0.00 

-0.11 

3NF210 

A 

1 

101 

93 

2.37 

0.14 

0.93 

0.39 

3NF210 

B 

0 

5 

5 

0.32 

0.36 

0.46 

-0.27 

3NF210 

C 

0 

3 

3 

-0.20 

0.22 

0.23 

-0.27 

3NF210 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF211 

* 

-1 

4877 

98 

1.19 

0.02 

0.00 

-0.10 

3NF211 

A 

1 

106 

91 

2.19 

0.11 

0.89 

0.40 

3NF211 

B 

0 

5 

4 

0.20 

0.21 

0.29 

-0.32 

3NF211 

C 

0 

6 

5 

0.80 

0.30 

0.60 

-0.24 

3NF211 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3NF212 

* 

-1 

4871 

98 

1.18 

0.02 

0.00 

-0.10 

3NF212 

A 

1 

109 

89 

2.28 

0.11 

0.79 

0.52 

3NF212 

B 

0 

4 

3 

0.23 

0.26 

0.29 

-0.27 

3NF212 

C 

0 

10 

8 

0.26 

0.18 

0.32 

-0.43 

3NF212 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF213 

* 

-1 

4865 

97 

1.19 

0.02 

0.00 

-0.09 

3NF213 

A 

1 

123 

95 

1.97 

0.11 

1.02 

0.20 

3NF213 

B 

0 

2 

2 

1.22 

0.98 

1.42 

-0.07 

3NF213 

C 

0 

4 

3 

0.53 

0.33 

0.55 

-0.20 

3NF213 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF214 

* 

-1 

4877 

98 

1.19 

0.02 

0.00 

-0.07 

3NF214 

A 

1 

106 

91 

1.91 

0.11 

1.00 

0.23 

3NF214 

B 

0 

4 

3 

0.66 

0.25 

0.54 

-0.19 

3NF214 

C 

0 

7 

6 

1.16 

0.44 

1.66 

-0.14 

3NF214 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF215 

* 

-1 

4864 

97 

1.18 

0.02 

0.00 

-0.12 

3NF215 

A 

1 

123 

95 

2.29 

0.10 

0.96 

0.32 

3NF215 

B 

0 

3 

2 

0.18 

0.28 

0.24 

-0.28 

3NF215 

C 

0 

4 

3 

1.10 

0.31 

0.63 

-0.18 

3NF215 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF216 

* 

-1 

4881 

98 

1.18 

0.02 

0.00 

-0.12 

3NF216 

A 

1 

99 

88 

2.50 

0.12 

0.88 

0.42 

3NF216 

B 

0 

5 

4 

0.34 

0.16 

0.24 

-0.34 

3NF216 

C 

0 

9 

8 

1.21 

0.32 

0.84 

-0.26 

3NF216 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF217 

* 

-1 

4886 

98 

1.20 

0.02 

0.00 

-0.05 

3NF217 

A 

1 

100 

93 

1.74 

0.12 

0.98 

0.21 

3NF217 

B 

0 

2 

2 

-0.10 

0.62 

0.36 

-0.20 

3NF217 

C 

0 

6 

6 

1.05 

0.53 

1.63 

-0.12 

3NF217 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3NF218 

* 

-1 

4885 

98 

1.17 

0.02 

0.00 

-0.16 

3NF218 

A 

-1 

109 

100 

2.68 

0.12 

0.00 

0.00 

3NF218 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF218 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF218 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF219 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.11 

3NF219 

A 

1 

105 

95 

2.24 

0.10 

0.90 

0.30 

3NF219 

B 

0 

5 

5 

0.79 

0.67 

1.16 

-0.27 

3NF219 

C 

0 

1 

1 

0.68 

0.00 

0.37 

-0.13 

3NF219 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF22 

* 

-1 

4756 

95 

1.16 

0.02 

0.00 

-0.14 

3NF22 

A 

1 

219 

92 

2.19 

0.08 

0.89 

0.38 

3NF22 

B 

0 

5 

2 

0.35 

0.37 

0.42 

-0.20 

3NF22 

C 

0 

14 

6 

0.50 

0.21 

0.49 

-0.32 

3NF22 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF220 

* 

-1 

4865 

97 

1.19 

0.02 

0.00 

-0.09 

3NF220 

A 

1 

118 

91 

2.05 

0.11 

0.95 

0.28 

3NF220 

B 

0 

7 

5 

0.75 

0.44 

0.80 

-0.23 

3NF220 

C 

0 

4 

3 

0.89 

0.45 

0.78 

-0.15 

3NF220 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF221 

* 

-1 

4876 

98 

1.18 

0.02 

0.00 

-0.11 

3NF221 

A 

1 

109 

92 

2.23 

0.12 

0.98 

0.30 

3NF221 

B 

0 

9 

8 

0.73 

0.33 

0.75 

-0.30 

3NF221 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF221 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF222 

* 

-1 

4774 

96 

1.18 

0.02 

0.00 

-0.11 

3NF222 

A 

1 

204 

93 

2.00 

0.09 

0.94 

0.33 

3NF222 

B 

0 

11 

5 

0.05 

0.21 

0.42 

-0.30 

3NF222 

C 

0 

5 

2 

0.63 

0.48 

0.94 

-0.14 

3NF222 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3NF223 

* 

-1 

4876 

98 

1.19 

0.02 

0.00 

-0.08 

3NF223 

A 

1 

101 

86 

2.05 

0.11 

1.01 

0.28 

3NF223 

B 

0 

5 

4 

1.14 

0.60 

1.55 

-0.15 

3NF223 

C 

0 

12 

10 

1.18 

0.15 

0.77 

-0.23 

3NF223 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF224 

* 

-1 

4879 

98 

1.19 

0.02 

0.00 

-0.07 

3NF224 

A 

1 

112 

97 

1.90 

0.09 

0.93 

0.32 

3NF224 

B 

0 

1 

1 

-0.32 

0.00 

0.20 

-0.19 

3NF224 

C 

0 

2 

2 

-0.15 

0.90 

0.35 

-0.25 

3NF224 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF225 

* 

-1 

4884 

98 

1.20 

0.02 

0.00 

-0.04 

3NF225 

A 

1 

102 

93 

1.67 

0.12 

0.94 

0.35 

3NF225 

B 

0 

4 

4 

0.07 

0.18 

0.40 

-0.24 

3NF225 

C 

0 

4 

4 

0.04 

0.36 

0.46 

-0.25 

3NF225 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF226 

* 

-1 

4887 

98 

1.18 

0.02 

0.00 

-0.11 

3NF226 

A 

1 

103 

96 

2.33 

0.14 

0.91 

0.34 

3NF226 

B 

0 

2 

2 

-0.34 

0.06 

0.20 

-0.23 

3NF226 

C 

0 

2 

2 

-0.47 

0.19 

0.18 

-0.25 

3NF226 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF227 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.10 

3NF227 

A 

1 

101 

87 

2.20 

0.12 

0.95 

0.34 

3NF227 

B 

0 

12 

10 

1.15 

0.26 

0.89 

-0.25 

3NF227 

C 

0 

3 

3 

0.20 

0.29 

0.27 

-0.25 

3NF227 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF228 

* 

-1 

4874 

98 

1.18 

0.02 

0.00 

-0.10 

3NF228 

A 

1 

111 

93 

2.17 

0.11 

0.92 

0.33 

3NF228 

B 

0 

4 

3 

0.83 

0.59 

0.82 

-0.18 

3NF228 

C 

0 

5 

4 

0.46 

0.40 

0.47 

-0.27 

3NF228 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3NF229 

* 

-1 

4868 

97 

1.19 

0.02 

0.00 

-0.08 

3NF229 

A 

1 

105 

83 

2.11 

0.12 

0.99 

0.37 

3NF229 

B 

0 

6 

5 

0.66 

0.32 

0.56 

-0.22 

3NF229 

C 

0 

15 

12 

0.93 

0.27 

1.06 

-0.28 

3NF229 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF23 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.07 

3NF23 

A 

1 

97 

84 

2.04 

0.12 

0.93 

0.43 

3NF23 

B 

0 

9 

8 

0.73 

0.16 

0.55 

-0.27 

3NF23 

C 

0 

10 

9 

0.66 

0.17 

0.53 

-0.30 

3NF23 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF230 

* 

-1 

4869 

97 

1.18 

0.02 

0.00 

-0.12 

3NF230 

A 

1 

106 

85 

2.40 

0.10 

0.93 

0.42 

3NF230 

B 

0 

12 

10 

1.29 

0.31 

1.22 

-0.27 

3NF230 

C 

0 

7 

6 

0.78 

0.31 

0.47 

-0.31 

3NF230 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF231 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.12 

3NF231 

A 

1 

99 

89 

2.45 

0.12 

0.97 

0.34 

3NF231 

B 

0 

8 

7 

1.09 

0.34 

0.77 

-0.28 

3NF231 

C 

0 

4 

4 

1.10 

0.47 

0.71 

-0.19 

3NF231 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF232 

* 

-1 

4888 

98 

1.20 

0.02 

0.00 

-0.04 

3NF232 

A 

1 

82 

77 

1.79 

0.13 

1.03 

0.28 

3NF232 

B 

0 

6 

6 

0.91 

0.56 

1.67 

-0.15 

3NF232 

C 

0 

18 

17 

1.04 

0.28 

1.48 

-0.22 

3NF232 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF233 

* 

-1 

4886 

98 

1.17 

0.02 

0.00 

-0.16 

3NF233 

A 

1 

102 

94 

2.80 

0.12 

0.93 

0.34 

3NF233 

B 

0 

2 

2 

0.35 

0.21 

0.18 

-0.25 

3NF233 

C 

0 

4 

4 

1.17 

0.39 

0.54 

-0.24 

3NF233 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3NF234 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.11 

3NF234 

A 

1 

101 

91 

2.28 

0.11 

0.95 

0.34 

3NF234 

B 

0 

4 

4 

0.83 

0.26 

0.45 

-0.23 

3NF234 

C 

0 

6 

5 

1.04 

0.35 

0.65 

-0.24 

3NF234 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF235 

* 

-1 

4873 

98 

1.19 

0.02 

0.00 

-0.09 

3NF235 

A 

1 

88 

73 

2.14 

0.13 

1.11 

0.22 

3NF235 

B 

0 

23 

19 

1.46 

0.23 

1.66 

-0.20 

3NF235 

C 

0 

10 

8 

1.71 

0.30 

1.53 

-0.06 

3NF235 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF236 

* 

-1 

4879 

98 

1.18 

0.02 

0.00 

-0.11 

3NF236 

A 

1 

95 

83 

2.34 

0.13 

1.04 

0.35 

3NF236 

B 

0 

14 

12 

1.36 

0.21 

1.05 

-0.21 

3NF236 

C 

0 

6 

5 

0.54 

0.48 

0.58 

-0.28 

3NF236 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF237 

* 

-1 

4759 

95 

1.16 

0.02 

0.00 

-0.14 

3NF237 

A 

1 

213 

91 

2.16 

0.08 

0.99 

0.28 

3NF237 

B 

0 

14 

6 

1.10 

0.18 

0.75 

-0.20 

3NF237 

C 

0 

8 

3 

0.90 

0.28 

0.67 

-0.18 

3NF237 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF238 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.08 

3NF238 

A 

1 

35 

30 

1.95 

0.24 

2.22 

0.00 

3NF238 

B 

0 

70 

60 

2.01 

0.11 

1.41 

0.08 

3NF238 

C 

0 

11 

9 

1.46 

0.26 

0.73 

-0.14 

3NF238 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF239 

* 

-1 

4887 

98 

1.19 

0.02 

0.00 

-0.07 

3NF239 

A 

1 

30 

28 

2.05 

0.21 

1.86 

0.14 

3NF239 

B 

0 

7 

7 

1.06 

0.44 

0.59 

-0.19 

3NF239 

C 

0 

70 

65 

1.77 

0.12 

1.19 

-0.04 

3NF239 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3NF24 

* 

-1 

4884 

98 

1.20 

0.02 

0.00 

-0.04 

3NF24 

A 

1 

104 

95 

1.65 

0.11 

0.93 

0.34 

3NF24 

B 

0 

4 

4 

-0.22 

0.11 

0.30 

-0.29 

3NF24 

C 

0 

2 

2 

0.00 

0.32 

0.38 

-0.18 

3NF24 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF240 

* 

-1 

4887 

98 

1.18 

0.02 

0.00 

-0.11 

3NF240 

A 

1 

96 

90 

2.48 

0.14 

0.79 

0.50 

3NF240 

B 

0 

3 

3 

0.17 

0.25 

0.31 

-0.23 

3NF240 

C 

0 

8 

7 

-0.05 

0.28 

0.31 

-0.43 

3NF240 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF241 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.10 

3NF241 

A 

1 

87 

75 

2.31 

0.13 

1.03 

0.38 

3NF241 

B 

0 

19 

16 

1.18 

0.22 

0.98 

-0.31 

3NF241 

C 

0 

10 

9 

1.35 

0.28 

1.01 

-0.17 

3NF241 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF242 

* 

-1 

4874 

98 

1.18 

0.02 

0.00 

-0.10 

3NF242 

A 

1 

69 

58 

2.53 

0.16 

1.11 

0.45 

3NF242 

B 

0 

18 

15 

1.35 

0.20 

0.80 

-0.24 

3NF242 

C 

0 

33 

28 

1.42 

0.14 

0.82 

-0.31 

3NF242 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF243 

* 

-1 

4869 

97 

1.19 

0.02 

0.00 

-0.08 

3NF243 

A 

1 

71 

57 

2.35 

0.15 

1.32 

0.40 

3NF243 

B 

0 

23 

18 

1.20 

0.21 

0.87 

-0.27 

3NF243 

C 

0 

31 

25 

1.42 

0.16 

0.95 

-0.22 

3NF243 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF244 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.07 

3NF244 

A 

1 

71 

61 

2.17 

0.15 

1.12 

0.38 

3NF244 

B 

0 

23 

20 

1.14 

0.15 

0.78 

-0.29 

3NF244 

C 

0 

22 

19 

1.39 

0.19 

1.15 

-0.18 

3NF244 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3NF245 

* 

-1 

4871 

98 

1.18 

0.02 

0.00 

-0.12 

3NF245 

A 

1 

94 

76 

2.43 

0.11 

1.03 

0.35 

3NF245 

B 

0 

12 

10 

1.21 

0.22 

0.62 

-0.29 

3NF245 

C 

0 

17 

14 

1.72 

0.27 

1.38 

-0.18 

3NF245 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF246 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.12 

3NF246 

A 

1 

89 

80 

2.49 

0.13 

1.12 

0.30 

3NF246 

B 

0 

10 

9 

1.73 

0.27 

1.14 

-0.15 

3NF246 

C 

0 

12 

11 

1.43 

0.27 

0.96 

-0.25 

3NF246 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF247 

* 

-1 

4888 

98 

1.20 

0.02 

0.00 

-0.04 

3NF247 

A 

1 

81 

76 

1.92 

0.12 

0.94 

0.46 

3NF247 

B 

0 

16 

15 

0.97 

0.18 

0.92 

-0.23 

3NF247 

C 

0 

9 

8 

0.03 

0.21 

0.33 

-0.41 

3NF247 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF248 

* 

-1 

4750 

95 

1.17 

0.02 

0.00 

-0.11 

3NF248 

A 

1 

155 

64 

2.19 

0.10 

1.18 

0.36 

3NF248 

B 

0 

59 

24 

1.30 

0.11 

0.97 

-0.27 

3NF248 

C 

0 

30 

12 

1.27 

0.18 

1.39 

-0.18 

3NF248 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF249 

* 

-1 

4888 

98 

1.17 

0.02 

0.00 

-0.17 

3NF249 

A 

1 

63 

59 

3.11 

0.16 

1.12 

0.38 

3NF249 

B 

0 

13 

12 

1.99 

0.35 

1.11 

-0.21 

3NF249 

C 

0 

30 

28 

2.19 

0.18 

1.09 

-0.26 

3NF249 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF25 

* 

-1 

4884 

98 

1.18 

0.02 

0.00 

-0.11 

3NF25 

A 

1 

100 

91 

2.28 

0.11 

0.97 

0.31 

3NF25 

B 

0 

6 

5 

0.79 

0.25 

0.44 

-0.30 

3NF25 

C 

0 

4 

4 

1.51 

0.67 

1.78 

-0.11 

3NF25 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3NF250 

* 

-1 

4873 

98 

1.19 

0.02 

0.00 

-0.09 

3NF250 

A 

1 

75 

62 

2.36 

0.15 

1.02 

0.40 

3NF250 

B 

0 

15 

12 

1.60 

0.23 

1.22 

-0.12 

3NF250 

C 

0 

31 

26 

1.24 

0.15 

0.81 

-0.36 

3NF250 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF251 

* 

-1 

4880 

98 

1.18 

0.02 

0.00 

-0.11 

3NF251 

A 

1 

88 

77 

2.38 

0.14 

1.09 

0.35 

3NF251 

B 

0 

9 

8 

0.93 

0.47 

1.42 

-0.26 

3NF251 

C 

0 

17 

15 

1.43 

0.20 

1.03 

-0.22 

3NF251 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF252 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.08 

3NF252 

A 

1 

70 

60 

2.33 

0.13 

1.00 

0.44 

3NF252 

B 

0 

21 

18 

1.30 

0.18 

0.84 

-0.28 

3NF252 

C 

0 

25 

22 

1.40 

0.14 

0.87 

-0.26 

3NF252 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF253 

* 

-1 

4887 

98 

1.19 

0.02 

0.00 

-0.07 

3NF253 

A 

1 

79 

74 

2.00 

0.12 

1.18 

0.31 

3NF253 

B 

0 

10 

9 

1.17 

0.35 

1.14 

-0.19 

3NF253 

C 

0 

18 

17 

1.30 

0.20 

1.03 

-0.22 

3NF253 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF254 

* 

-1 

4886 

98 

1.20 

0.02 

0.00 

-0.04 

3NF254 

A 

1 

69 

64 

1.80 

0.15 

1.20 

0.28 

3NF254 

B 

0 

18 

17 

1.07 

0.18 

1.03 

-0.17 

3NF254 

C 

0 

21 

19 

1.10 

0.23 

1.34 

-0.18 

3NF254 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF255 

* 

-1 

4887 

98 

1.18 

0.02 

0.00 

-0.11 

3NF255 

A 

1 

70 

65 

2.80 

0.17 

1.02 

0.53 

3NF255 

B 

0 

24 

22 

1.42 

0.22 

1.13 

-0.29 

3NF255 

C 

0 

13 

12 

0.61 

0.26 

0.49 

-0.40 

3NF255 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3NF256 

* 

-1 

4880 

98 

1.19 

0.02 

0.00 

-0.10 

3NF256 

A 

1 

85 

75 

2.37 

0.13 

0.96 

0.44 

3NF256 

B 

0 

11 

10 

1.23 

0.26 

0.86 

-0.22 

3NF256 

C 

0 

18 

16 

1.07 

0.20 

0.74 

-0.35 

3NF256 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF257 

* 

-1 

4875 

98 

1.19 

0.02 

0.00 

-0.10 

3NF257 

A 

1 

81 

68 

2.34 

0.14 

1.16 

0.34 

3NF257 

B 

0 

12 

10 

1.45 

0.33 

1.35 

-0.16 

3NF257 

C 

0 

26 

22 

1.43 

0.17 

1.00 

-0.26 

3NF257 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF258 

* 

-1 

4870 

98 

1.19 

0.02 

0.00 

-0.08 

3NF258 

A 

1 

86 

69 

2.27 

0.13 

1.02 

0.44 

3NF258 

B 

0 

21 

17 

0.95 

0.24 

0.94 

-0.34 

3NF258 

C 

0 

17 

14 

1.22 

0.22 

0.97 

-0.21 

3NF258 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF259 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.07 

3NF259 

A 

1 

78 

67 

2.15 

0.14 

1.04 

0.40 

3NF259 

B 

0 

18 

16 

1.25 

0.16 

0.91 

-0.21 

3NF259 

C 

0 

20 

17 

1.05 

0.18 

0.81 

-0.30 

3NF259 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF26 

* 

-1 

4871 

98 

1.18 

0.02 

0.00 

-0.12 

3NF26 

A 

1 

116 

94 

2.30 

0.10 

0.95 

0.33 

3NF26 

B 

0 

5 

4 

0.94 

0.41 

0.68 

-0.23 

3NF26 

C 

0 

2 

2 

0.15 

0.14 

0.21 

-0.24 

3NF26 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF260 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.12 

3NF260 

A 

1 

77 

69 

2.57 

0.14 

1.15 

0.33 

3NF260 

B 

0 

9 

8 

1.31 

0.27 

0.67 

-0.24 

3NF260 

C 

0 

25 

23 

1.84 

0.21 

1.33 

-0.20 

3NF260 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3NF261 

* 

-1 

4888 

98 

1.20 

0.02 

0.00 

-0.04 

3NF261 

A 

1 

99 

93 

1.73 

0.11 

0.91 

0.38 

3NF261 

B 

0 

3 

3 

-0.50 

0.36 

0.23 

-0.31 

3NF261 

C 

0 

4 

4 

0.22 

0.17 

0.44 

-0.23 

3NF261 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF262 

* 

-1 

4888 

98 

1.17 

0.02 

0.00 

-0.17 

3NF262 

A 

1 

84 

79 

2.97 

0.13 

1.09 

0.40 

3NF262 

B 

0 

7 

7 

1.60 

0.42 

0.94 

-0.23 

3NF262 

C 

0 

15 

14 

1.79 

0.22 

0.86 

-0.30 

3NF262 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF263 

* 

-1 

4761 

95 

1.17 

0.02 

0.00 

-0.14 

3NF263 

A 

1 

184 

79 

2.23 

0.09 

1.04 

0.32 

3NF263 

B 

0 

23 

10 

1.26 

0.20 

0.97 

-0.21 

3NF263 

C 

0 

26 

11 

1.29 

0.18 

1.00 

-0.21 

3NF263 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF264 

* 

-1 

4884 

98 

1.18 

0.02 

0.00 

-0.11 

3NF264 

A 

1 

54 

49 

2.55 

0.17 

1.28 

0.33 

3NF264 

B 

0 

29 

26 

1.84 

0.17 

1.07 

-0.18 

3NF264 

C 

0 

27 

25 

1.78 

0.16 

1.01 

-0.20 

3NF264 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF265 

* 

-1 

4874 

98 

1.19 

0.02 

0.00 

-0.09 

3NF265 

A 

1 

71 

59 

2.41 

0.15 

0.97 

0.44 

3NF265 

B 

0 

32 

27 

1.49 

0.16 

1.15 

-0.24 

3NF265 

C 

0 

17 

14 

1.03 

0.14 

0.55 

-0.31 

3NF265 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF266 

* 

-1 

4880 

98 

1.18 

0.02 

0.00 

-0.11 

3NF266 

A 

1 

99 

87 

2.29 

0.13 

1.01 

0.30 

3NF266 

B 

0 

4 

4 

0.96 

0.35 

0.65 

-0.17 

3NF266 

C 

0 

11 

10 

1.13 

0.39 

1.34 

-0.24 

3NF266 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3NF267 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.08 

3NF267 

A 

1 

72 

62 

2.36 

0.13 

0.99 

0.50 

3NF267 

B 

0 

29 

25 

1.21 

0.10 

0.65 

-0.39 

3NF267 

C 

0 

15 

13 

1.34 

0.17 

0.80 

-0.21 

3NF267 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF268 

* 

-1 

4888 

98 

1.19 

0.02 

0.00 

-0.07 

3NF268 

A 

1 

65 

61 

2.19 

0.11 

0.88 

0.47 

3NF268 

B 

0 

22 

21 

1.01 

0.21 

0.74 

-0.38 

3NF268 

C 

0 

19 

18 

1.38 

0.24 

1.25 

-0.19 

3NF268 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF269 

* 

-1 

4886 

98 

1.20 

0.02 

0.00 

-0.04 

3NF269 

A 

1 

65 

60 

1.83 

0.16 

1.27 

0.29 

3NF269 

B 

0 

16 

15 

1.00 

0.22 

1.05 

-0.19 

3NF269 

C 

0 

27 

25 

1.17 

0.19 

1.33 

-0.18 

3NF269 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF27 

* 

-1 

4887 

98 

1.18 

0.02 

0.00 

-0.11 

3NF27 

A 

1 

98 

92 

2.41 

0.14 

0.89 

0.40 

3NF27 

B 

0 

3 

3 

-0.70 

0.12 

0.13 

-0.33 

3NF27 

C 

0 

6 

6 

0.67 

0.34 

0.69 

-0.25 

3NF27 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF270 

* 

-1 

4880 

98 

1.19 

0.02 

0.00 

-0.10 

3NF270 

A 

1 

86 

75 

2.28 

0.13 

1.05 

0.32 

3NF270 

B 

0 

19 

17 

1.72 

0.24 

1.61 

-0.12 

3NF270 

C 

0 

9 

8 

0.65 

0.23 

0.44 

-0.34 

3NF270 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF271 

* 

-1 

4875 

98 

1.19 

0.02 

0.00 

-0.10 

3NF271 

A 

1 

98 

82 

2.30 

0.11 

0.83 

0.42 

3NF271 

B 

0 

9 

8 

0.56 

0.23 

0.43 

-0.34 

3NF271 

C 

0 

12 

10 

1.18 

0.45 

3.25 

-0.23 

3NF271 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3NF272 

* 

-1 

4870 

98 

1.19 

0.02 

0.00 

-0.08 

3NF272 

A 

1 

95 

77 

2.22 

0.12 

0.89 

0.46 

3NF272 

B 

0 

22 

18 

1.13 

0.23 

1.27 

-0.29 

3NF272 

C 

0 

7 

6 

0.02 

0.14 

0.24 

-0.37 

3NF272 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF273 

* 

-1 

4880 

98 

1.19 

0.02 

0.00 

-0.07 

3NF273 

A 

1 

77 

68 

1.91 

0.13 

1.27 

0.15 

3NF273 

B 

0 

30 

26 

1.72 

0.18 

1.77 

-0.04 

3NF273 

C 

0 

7 

6 

0.89 

0.17 

0.54 

-0.21 

3NF273 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF274 

* 

-1 

4872 

98 

1.18 

0.02 

0.00 

-0.12 

3NF274 

A 

1 

91 

75 

2.40 

0.12 

1.08 

0.30 

3NF274 

B 

0 

24 

20 

1.89 

0.18 

1.41 

-0.14 

3NF274 

C 

0 

7 

6 

0.77 

0.42 

0.52 

-0.31 

3NF274 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF275 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.12 

3NF275 

A 

1 

87 

78 

2.52 

0.13 

1.10 

0.33 

3NF275 

B 

0 

21 

19 

1.59 

0.18 

0.94 

-0.28 

3NF275 

C 

0 

3 

3 

1.07 

0.54 

0.56 

-0.17 

3NF275 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF276 

* 

-1 

4888 

98 

1.20 

0.02 

0.00 

-0.04 

3NF276 

A 

1 

72 

68 

1.92 

0.14 

1.10 

0.37 

3NF276 

B 

0 

21 

20 

1.10 

0.20 

1.07 

-0.22 

3NF276 

C 

0 

13 

12 

0.75 

0.21 

0.68 

-0.27 

3NF276 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF277 

* 

-1 

4888 

98 

1.17 

0.02 

0.00 

-0.17 

3NF277 

A 

1 

74 

70 

3.02 

0.14 

1.07 

0.37 

3NF277 

B 

0 

8 

8 

1.58 

0.45 

0.83 

-0.26 

3NF277 

C 

0 

24 

23 

2.14 

0.23 

1.48 

-0.24 

3NF277 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3NF278 

* 

-1 

4885 

98 

1.18 

0.02 

0.00 

-0.11 

3NF278 

A 

1 

83 

76 

2.51 

0.11 

0.82 

0.53 

3NF278 

B 

0 

8 

7 

1.32 

0.26 

0.76 

-0.21 

3NF278 

C 

0 

18 

17 

1.01 

0.17 

0.52 

-0.46 

3NF278 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF279 

* 

-1 

4875 

98 

1.19 

0.02 

0.00 

-0.09 

3NF279 

A 

1 

94 

79 

2.21 

0.13 

1.01 

0.37 

3NF279 

B 

0 

15 

13 

1.24 

0.16 

0.83 

-0.23 

3NF279 

C 

0 

10 

8 

0.86 

0.15 

0.52 

-0.28 

3NF279 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF28 

* 

-1 

4883 

98 

1.19 

0.02 

0.00 

-0.10 

3NF28 

A 

1 

103 

93 

2.21 

0.13 

0.96 

0.31 

3NF28 

B 

0 

7 

6 

0.82 

0.30 

0.67 

-0.25 

3NF28 

C 

0 

1 

1 

-0.65 

0.00 

0.12 

-0.20 

3NF28 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF280 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.08 

3NF280 

A 

1 

70 

60 

2.33 

0.13 

0.97 

0.44 

3NF280 

B 

0 

22 

19 

1.35 

0.13 

0.78 

-0.27 

3NF280 

C 

0 

24 

21 

1.36 

0.18 

0.91 

-0.28 

3NF280 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF29 

* 

-1 

4888 

98 

1.19 

0.02 

0.00 

-0.07 

3NF29 

A 

1 

98 

92 

1.88 

0.10 

0.98 

0.26 

3NF29 

B 

0 

5 

5 

0.92 

0.72 

1.44 

-0.19 

3NF29 

C 

0 

3 

3 

0.68 

0.45 

0.61 

-0.18 

3NF29 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF31 

* 

-1 

4887 

98 

1.20 

0.02 

0.00 

-0.04 

3NF31 

A 

1 

50 

47 

2.32 

0.16 

0.80 

0.61 

3NF31 

B 

0 

34 

32 

0.77 

0.13 

0.64 

-0.43 

3NF31 

C 

0 

23 

21 

0.96 

0.17 

0.78 

-0.25 

3NF31 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3NF310 

* 

-1 

4887 

98 

1.18 

0.02 

0.00 

-0.11 

3NF310 

A 

1 

73 

68 

2.71 

0.17 

1.14 

0.48 

3NF310 

B 

0 

28 

26 

1.40 

0.19 

1.07 

-0.33 

3NF310 

C 

0 

6 

6 

0.14 

0.36 

0.27 

-0.34 

3NF310 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF311 

* 

-1 

4880 

98 

1.19 

0.02 

0.00 

-0.10 

3NF311 

A 

1 

58 

51 

2.74 

0.15 

0.99 

0.57 

3NF311 

B 

0 

36 

32 

1.49 

0.13 

0.88 

-0.31 

3NF311 

C 

0 

20 

18 

1.09 

0.19 

0.61 

-0.36 

3NF311 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF312 

* 

-1 

4875 

98 

1.19 

0.02 

0.00 

-0.10 

3NF312 

A 

1 

32 

27 

3.26 

0.22 

0.63 

0.59 

3NF312 

B 

0 

40 

34 

1.74 

0.14 

0.87 

-0.18 

3NF312 

C 

0 

47 

39 

1.50 

0.14 

0.75 

-0.36 

3NF312 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF313 

* 

-1 

4872 

98 

1.19 

0.02 

0.00 

-0.08 

3NF313 

A 

1 

82 

67 

2.39 

0.13 

0.87 

0.55 

3NF313 

B 

0 

9 

7 

1.40 

0.38 

1.24 

-0.11 

3NF313 

C 

0 

31 

25 

0.76 

0.14 

0.53 

-0.53 

3NF313 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF314 

* 

-1 

4880 

98 

1.19 

0.02 

0.00 

-0.07 

3NF314 

A 

1 

71 

62 

2.05 

0.14 

1.13 

0.29 

3NF314 

B 

0 

20 

18 

1.62 

0.20 

1.41 

-0.07 

3NF314 

C 

0 

23 

20 

1.19 

0.19 

0.99 

-0.28 

3NF314 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF315 

* 

-1 

4872 

98 

1.18 

0.02 

0.00 

-0.12 

3NF315 

A 

1 

61 

50 

2.42 

0.15 

1.39 

0.19 

3NF315 

B 

0 

56 

46 

2.08 

0.13 

1.42 

-0.10 

3NF315 

C 

0 

5 

4 

1.02 

0.56 

0.55 

-0.22 

3NF315 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3NF316 

* 

-1 

4884 

98 

1.18 

0.02 

0.00 

-0.12 

3NF316 

A 

1 

74 

67 

2.77 

0.13 

0.87 

0.54 

3NF316 

B 

0 

23 

21 

1.42 

0.18 

0.78 

-0.37 

3NF316 

C 

0 

13 

12 

1.24 

0.22 

0.59 

-0.32 

3NF316 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF317 

* 

-1 

4888 

98 

1.20 

0.02 

0.00 

-0.04 

3NF317 

A 

1 

56 

53 

2.23 

0.15 

0.88 

0.55 

3NF317 

B 

0 

16 

15 

0.82 

0.29 

0.86 

-0.28 

3NF317 

C 

0 

34 

32 

0.97 

0.12 

0.71 

-0.37 

3NF317 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF318 

* 

-1 

4888 

98 

1.17 

0.02 

0.00 

-0.17 

3NF318 

A 

1 

90 

85 

2.94 

0.13 

1.01 

0.44 

3NF318 

B 

0 

3 

3 

0.65 

0.12 

0.21 

-0.28 

3NF318 

C 

0 

13 

12 

1.58 

0.16 

0.61 

-0.34 

3NF318 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF319 

* 

-1 

4885 

98 

1.18 

0.02 

0.00 

-0.11 

3NF319 

A 

1 

78 

72 

2.51 

0.12 

0.94 

0.47 

3NF319 

B 

0 

16 

15 

1.53 

0.17 

0.90 

-0.23 

3NF319 

C 

0 

15 

14 

1.11 

0.20 

0.58 

-0.38 

3NF319 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF32 

* 

-1 

4875 

98 

1.19 

0.02 

0.00 

-0.09 

3NF32 

A 

1 

75 

63 

2.28 

0.15 

1.13 

0.32 

3NF32 

B 

0 

33 

28 

1.39 

0.15 

1.00 

-0.30 

3NF32 

C 

0 

11 

9 

1.67 

0.29 

1.34 

-0.08 

3NF32 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF320 

* 

-1 

4778 

96 

1.16 

0.02 

0.00 

-0.15 

3NF320 

A 

1 

126 

58 

2.87 

0.11 

0.95 

0.62 

3NF320 

B 

0 

17 

8 

1.52 

0.17 

0.80 

-0.14 

3NF320 

C 

0 

73 

34 

1.11 

0.10 

0.60 

-0.56 

3NF320 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3NF33 

* 

-1 

4768 

95 

1.17 

0.02 

0.00 

-0.13 

3NF33 

A 

1 

113 

50 

2.19 

0.12 

1.51 

0.14 

3NF33 

B 

0 

66 

29 

2.10 

0.13 

1.94 

0.04 

3NF33 

C 

0 

47 

21 

1.50 

0.16 

1.16 

-0.22 

3NF33 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF34 

* 

-1 

4755 

95 

1.15 

0.02 

0.00 

-0.18 

3NF34 

A 

1 

164 

69 

2.64 

0.09 

1.01 

0.48 

3NF34 

B 

0 

58 

24 

1.42 

0.09 

0.68 

-0.40 

3NF34 

C 

0 

17 

7 

1.43 

0.24 

0.80 

-0.20 

3NF34 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF35 

* 

-1 

4772 

96 

1.17 

0.02 

0.00 

-0.11 

3NF35 

A 

1 

114 

51 

2.06 

0.11 

1.42 

0.18 

3NF35 

B 

0 

59 

27 

1.62 

0.14 

1.32 

-0.14 

3NF35 

C 

0 

49 

22 

1.74 

0.11 

1.20 

-0.07 

3NF35 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF36 

* 

-1 

4779 

96 

1.17 

0.02 

0.00 

-0.12 

3NF36 

A 

1 

105 

49 

2.67 

0.11 

0.98 

0.57 

3NF36 

B 

0 

25 

12 

1.46 

0.24 

1.09 

-0.15 

3NF36 

C 

0 

85 

40 

1.23 

0.08 

0.67 

-0.49 

3NF36 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF37 

* 

-1 

4884 

98 

1.18 

0.02 

0.00 

-0.12 

3NF37 

A 

1 

51 

46 

3.04 

0.17 

1.08 

0.56 

3NF37 

B 

0 

37 

34 

1.60 

0.13 

0.68 

-0.41 

3NF37 

C 

0 

22 

20 

1.79 

0.17 

0.81 

-0.21 

3NF37 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3NF38 

* 

-1 

4888 

98 

1.20 

0.02 

0.00 

-0.04 

3NF38 

A 

1 

17 

16 

1.56 

0.32 

3.21 

-0.02 

3NF38 

B 

0 

26 

25 

1.39 

0.19 

0.89 

-0.11 

3NF38 

C 

0 

63 

59 

1.72 

0.16 

1.51 

0.11 

3NF38 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3NF39 

* 

-1 

4888 

98 

1.17 

0.02 

0.00 

-0.17 

3NF39 

A 

1 

61 

58 

3.25 

0.15 

1.04 

0.49 

3NF39 

B 

0 

36 

34 

1.87 

0.16 

0.77 

-0.48 

3NF39 

C 

0 

9 

8 

2.44 

0.35 

1.32 

-0.07 

3NF39 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A11 

* 

-1 

4884 

98 

1.20 

0.02 

0.00 

-0.04 

30A11 

A 

1 

104 

95 

1.59 

0.12 

1.03 

0.13 

30A11 

B 

0 

1 

1 

0.32 

0.00 

0.50 

-0.10 

30A11 

C 

0 

5 

5 

1.05 

0.50 

1.55 

-0.09 

30A11 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3OA110 

* 

-1 

4887 

98 

1.18 

0.02 

0.00 

-0.11 

3OA110 

A 

1 

87 

81 

2.57 

0.15 

0.93 

0.48 

3OA110 

B 

0 

4 

4 

0.05 

0.37 

0.27 

-0.28 

3OA110 

C 

0 

16 

15 

0.86 

0.26 

0.90 

-0.38 

3OA110 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A111 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.10 

30A111 

A 

1 

103 

89 

2.24 

0.11 

0.85 

0.47 

30A111 

B 

0 

10 

9 

0.48 

0.16 

0.39 

-0.39 

30A111 

C 

0 

3 

3 

0.24 

0.32 

0.30 

-0.24 

30A111 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A112 

* 

-1 

4874 

98 

1.18 

0.02 

0.00 

-0.10 

30A112 

A 

1 

107 

89 

2.19 

0.12 

0.97 

0.31 

30A112 

B 

0 

3 

3 

0.65 

0.59 

0.54 

-0.18 

30A112 

C 

0 

10 

8 

1.03 

0.31 

0.88 

-0.25 

30A112 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A113 

* 

-1 

4868 

97 

1.19 

0.02 

0.00 

-0.08 

30A113 

A 

1 

95 

75 

2.29 

0.12 

0.86 

0.55 

30A113 

B 

0 

14 

11 

0.79 

0.20 

0.60 

-0.31 

30A113 

C 

0 

17 

13 

0.63 

0.19 

0.53 

-0.40 

30A113 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30A114 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.07 

30A114 

A 

1 

84 

72 

2.15 

0.12 

0.91 

0.46 

30A114 

B 

0 

19 

16 

0.86 

0.18 

0.69 

-0.36 

30A114 

C 

0 

13 

11 

1.09 

0.21 

0.85 

-0.22 

30A114 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A115 

* 

-1 

4869 

97 

1.18 

0.02 

0.00 

-0.12 

30A115 

A 

1 

114 

91 

2.37 

0.10 

0.87 

0.46 

30A115 

B 

0 

5 

4 

0.70 

0.18 

0.37 

-0.28 

30A115 

C 

0 

6 

5 

0.45 

0.31 

0.35 

-0.35 

30A115 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A116 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.12 

30A116 

A 

1 

95 

86 

2.48 

0.12 

0.97 

0.34 

30A116 

B 

0 

8 

7 

1.72 

0.42 

1.47 

-0.13 

30A116 

C 

0 

8 

7 

0.84 

0.24 

0.46 

-0.33 

30A116 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A117 

* 

-1 

4774 

96 

1.18 

0.02 

0.00 

-0.11 

30A117 

A 

1 

199 

90 

1.99 

0.10 

1.03 

0.26 

30A117 

B 

0 

11 

5 

0.49 

0.30 

0.76 

-0.23 

30A117 

C 

0 

10 

5 

1.06 

0.29 

1.19 

-0.13 

30A117 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A118 

* 

-1 

4888 

98 

1.20 

0.02 

0.00 

-0.04 

30A118 

A 

1 

90 

85 

1.79 

0.12 

0.92 

0.36 

30A118 

B 

0 

5 

5 

0.70 

0.55 

1.01 

-0.17 

30A118 

C 

0 

11 

10 

0.55 

0.33 

0.97 

-0.31 

30A118 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A119 

* 

-1 

4886 

98 

1.17 

0.02 

0.00 

-0.16 

30A119 

A 

1 

91 

84 

2.88 

0.13 

1.07 

0.35 

30A119 

B 

0 

6 

6 

1.84 

0.42 

1.05 

-0.16 

30A119 

C 

0 

11 

10 

1.59 

0.20 

0.64 

-0.29 

30A119 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30A12 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.11 

30A12 

A 

1 

104 

94 

2.23 

0.11 

1.01 

0.24 

30A12 

B 

0 

2 

2 

1.97 

0.14 

1.33 

-0.02 

30A12 

C 

0 

5 

5 

0.78 

0.15 

0.42 

-0.27 

30A12 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3OA120 

* 

-1 

4873 

98 

1.19 

0.02 

0.00 

-0.09 

3OA120 

A 

1 

89 

74 

2.34 

0.12 

0.87 

0.50 

3OA120 

B 

0 

18 

15 

1.08 

0.14 

0.72 

-0.31 

3OA120 

C 

0 

14 

12 

0.80 

0.17 

0.52 

-0.35 

3OA120 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A13 

* 

-1 

4879 

98 

1.18 

0.02 

0.00 

-0.11 

30A13 

A 

1 

107 

93 

2.28 

0.12 

0.86 

0.42 

30A13 

B 

0 

5 

4 

0.02 

0.21 

0.25 

-0.34 

30A13 

C 

0 

3 

3 

0.14 

0.40 

0.30 

-0.24 

30A13 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A14 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.08 

30A14 

A 

1 

108 

93 

2.05 

0.10 

0.91 

0.36 

30A14 

B 

0 

3 

3 

0.31 

0.33 

0.33 

-0.25 

30A14 

C 

0 

5 

4 

0.66 

0.28 

0.49 

-0.25 

30A14 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A15 

* 

-1 

4887 

98 

1.19 

0.02 

0.00 

-0.07 

30A15 

A 

1 

101 

94 

1.84 

0.10 

1.03 

0.14 

30A15 

B 

0 

1 

1 

3.00 

0.00 

5.31 

0.11 

30A15 

C 

0 

5 

5 

0.82 

0.53 

0.93 

-0.21 

30A15 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A16 

* 

-1 

4759 

95 

1.16 

0.02 

0.00 

-0.14 

30A16 

A 

1 

177 

75 

2.33 

0.09 

0.95 

0.40 

30A16 

B 

0 

7 

3 

0.63 

0.36 

0.52 

-0.21 

30A16 

C 

0 

51 

22 

1.30 

0.11 

0.91 

-0.34 

30A16 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30A17 

* 

-1 

4884 

98 

1.20 

0.02 

0.00 

-0.04 

30A17 

A 

1 

71 

65 

1.93 

0.15 

1.06 

0.42 

30A17 

B 

0 

33 

30 

0.86 

0.14 

0.85 

-0.38 

30A17 

C 

0 

6 

5 

1.01 

0.39 

1.02 

-0.11 

30A17 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A18 

* 

-1 

4887 

98 

1.18 

0.02 

0.00 

-0.11 

30A18 

A 

1 

84 

79 

2.57 

0.15 

0.88 

0.43 

30A18 

B 

0 

2 

2 

1.33 

1.00 

1.16 

-0.08 

30A18 

C 

0 

21 

20 

0.94 

0.32 

1.66 

-0.42 

30A18 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A19 

* 

-1 

4879 

98 

1.19 

0.02 

0.00 

-0.10 

30A19 

A 

1 

107 

93 

2.08 

0.12 

1.08 

0.09 

30A19 

B 

0 

4 

3 

1.99 

0.53 

2.49 

-0.01 

30A19 

C 

0 

4 

3 

1.27 

0.46 

1.05 

-0.12 

30A19 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A41 

* 

-1 

4874 

98 

1.18 

0.02 

0.00 

-0.10 

30A41 

A 

1 

106 

88 

2.25 

0.11 

0.85 

0.45 

30A41 

B 

0 

5 

4 

0.21 

0.20 

0.28 

-0.31 

30A41 

C 

0 

9 

8 

0.67 

0.29 

0.58 

-0.32 

30A41 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3OA410 

* 

-1 

4869 

97 

1.19 

0.02 

0.00 

-0.08 

3OA410 

A 

1 

89 

71 

2.30 

0.12 

0.97 

0.50 

3OA410 

B 

0 

22 

18 

1.08 

0.18 

0.84 

-0.30 

3OA410 

C 

0 

14 

11 

0.66 

0.22 

0.52 

-0.35 

3OA410 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A411 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.07 

30A411 

A 

1 

78 

67 

2.26 

0.12 

0.85 

0.54 

30A411 

B 

0 

18 

16 

0.99 

0.19 

0.80 

-0.30 

30A411 

C 

0 

20 

17 

0.84 

0.13 

0.56 

-0.38 

30A411 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30A412 

* 

-1 

4871 

98 

1.18 

0.02 

0.00 

-0.12 

30A412 

A 

1 

100 

81 

2.44 

0.11 

0.97 

0.43 

30A412 

B 

0 

13 

11 

1.43 

0.18 

0.76 

-0.24 

30A412 

C 

0 

10 

8 

0.91 

0.30 

0.60 

-0.35 

30A412 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A413 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.12 

30A413 

A 

1 

89 

80 

2.56 

0.12 

0.92 

0.42 

30A413 

B 

0 

11 

10 

1.49 

0.32 

1.03 

-0.22 

30A413 

C 

0 

11 

10 

1.04 

0.24 

0.55 

-0.34 

30A413 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A414 

* 

-1 

4888 

98 

1.20 

0.02 

0.00 

-0.04 

30A414 

A 

1 

85 

80 

1.98 

0.11 

0.72 

0.63 

30A414 

B 

0 

9 

8 

0.14 

0.13 

0.35 

-0.38 

30A414 

C 

0 

12 

11 

0.10 

0.18 

0.37 

-0.46 

30A414 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A415 

* 

-1 

4888 

98 

1.17 

0.02 

0.00 

-0.17 

30A415 

A 

1 

80 

75 

3.00 

0.13 

0.94 

0.40 

30A415 

B 

0 

6 

6 

0.71 

0.17 

0.21 

-0.39 

30A415 

C 

0 

20 

19 

2.15 

0.26 

1.82 

-0.22 

30A415 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A416 

* 

-1 

4884 

98 

1.18 

0.02 

0.00 

-0.11 

30A416 

A 

1 

69 

63 

2.48 

0.14 

1.22 

0.35 

30A416 

B 

0 

28 

25 

1.69 

0.16 

1.10 

-0.25 

30A416 

C 

0 

13 

12 

1.58 

0.21 

0.86 

-0.19 

30A416 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A417 

* 

-1 

4873 

98 

1.19 

0.02 

0.00 

-0.09 

30A417 

A 

1 

78 

64 

2.29 

0.14 

1.07 

0.35 

30A417 

B 

0 

21 

17 

1.33 

0.17 

0.91 

-0.24 

30A417 

C 

0 

22 

18 

1.47 

0.22 

1.36 

-0.19 

30A417 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30A418 

* 

-1 

4880 

98 

1.18 

0.02 

0.00 

-0.11 

30A418 

A 

1 

74 

65 

2.63 

0.15 

0.93 

0.51 

30A418 

B 

0 

22 

19 

1.36 

0.21 

0.95 

-0.28 

30A418 

C 

0 

18 

16 

0.99 

0.21 

0.60 

-0.37 

30A418 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A419 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.08 

30A419 

A 

1 

86 

74 

2.28 

0.11 

0.84 

0.52 

30A419 

B 

0 

9 

8 

1.11 

0.22 

0.72 

-0.22 

30A419 

C 

0 

21 

18 

0.93 

0.14 

0.57 

-0.44 

30A419 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A42 

* 

-1 

4887 

98 

1.19 

0.02 

0.00 

-0.07 

30A42 

A 

1 

92 

86 

2.02 

0.09 

0.82 

0.51 

30A42 

B 

0 

6 

6 

0.77 

0.30 

0.62 

-0.24 

30A42 

C 

0 

9 

8 

0.28 

0.35 

0.49 

-0.44 

30A42 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3OA420 

* 

-1 

4886 

98 

1.20 

0.02 

0.00 

-0.04 

3OA420 

A 

1 

85 

79 

1.84 

0.13 

0.93 

0.48 

3OA420 

B 

0 

15 

14 

0.60 

0.16 

0.67 

-0.31 

3OA420 

C 

0 

8 

7 

0.10 

0.15 

0.37 

-0.34 

3OA420 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A43 

* 

-1 

4887 

98 

1.18 

0.02 

0.00 

-0.11 

30A43 

A 

1 

83 

78 

2.67 

0.15 

0.88 

0.55 

30A43 

B 

0 

9 

8 

0.45 

0.31 

0.43 

-0.36 

30A43 

C 

0 

15 

14 

0.82 

0.22 

0.62 

-0.38 

30A43 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A44 

* 

-1 

4761 

95 

1.17 

0.02 

0.00 

-0.14 

30A44 

A 

1 

211 

91 

2.18 

0.08 

0.88 

0.38 

30A44 

B 

0 

12 

5 

0.57 

0.28 

0.65 

-0.28 

30A44 

C 

0 

10 

4 

0.60 

0.28 

0.59 

-0.25 

30A44 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

easyCBM  CCSS  Third  Grade  Math  Measure  Development 


494 

Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30A45 

* 

-1 

4880 

98 

1.19 

0.02 

0.00 

-0.10 

30A45 

A 

1 

99 

87 

2.23 

0.12 

0.94 

0.36 

30A45 

B 

0 

1 

1 

-0.38 

0.00 

0.14 

-0.19 

30A45 

C 

0 

14 

12 

1.01 

0.25 

0.92 

-0.32 

30A45 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A46 

* 

-1 

4875 

98 

1.19 

0.02 

0.00 

-0.10 

30A46 

A 

1 

103 

87 

2.25 

0.12 

0.96 

0.40 

30A46 

B 

0 

9 

8 

1.00 

0.18 

0.63 

-0.24 

30A46 

C 

0 

7 

6 

0.55 

0.38 

0.65 

-0.30 

30A46 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A47 

* 

-1 

4756 

95 

1.16 

0.02 

0.00 

-0.14 

30A47 

A 

1 

206 

87 

2.19 

0.08 

1.04 

0.29 

30A47 

B 

0 

6 

3 

0.19 

0.18 

0.27 

-0.24 

30A47 

C 

0 

26 

11 

1.38 

0.18 

1.50 

-0.19 

30A47 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A48 

* 

-1 

4870 

98 

1.19 

0.02 

0.00 

-0.08 

30A48 

A 

1 

100 

81 

2.20 

0.12 

0.89 

0.48 

30A48 

B 

0 

10 

8 

0.58 

0.27 

0.59 

-0.31 

30A48 

C 

0 

14 

11 

0.73 

0.24 

0.69 

-0.33 

30A48 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A49 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.07 

30A49 

A 

1 

62 

53 

2.33 

0.15 

0.96 

0.47 

30A49 

B 

0 

14 

12 

1.24 

0.26 

0.92 

-0.18 

30A49 

C 

0 

40 

34 

1.22 

0.13 

0.89 

-0.37 

30A49 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A51 

* 

-1 

4871 

98 

1.18 

0.02 

0.00 

-0.12 

30A51 

A 

1 

118 

96 

2.29 

0.10 

0.95 

0.33 

30A51 

B 

0 

1 

1 

0.43 

0.00 

0.28 

-0.14 

30A51 

C 

0 

4 

3 

0.39 

0.21 

0.29 

-0.30 

30A51 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3OA510 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.12 

3OA510 

A 

1 

36 

32 

2.34 

0.23 

2.47 

0.02 

3OA510 

B 

0 

26 

23 

1.81 

0.22 

1.17 

-0.22 

3OA510 

C 

0 

49 

44 

2.54 

0.16 

2.10 

0.17 

3OA510 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A511 

* 

-1 

4888 

98 

1.20 

0.02 

0.00 

-0.04 

30A511 

A 

1 

96 

91 

1.78 

0.11 

0.87 

0.44 

30A511 

B 

0 

4 

4 

0.01 

0.51 

0.46 

-0.27 

30A511 

C 

0 

6 

6 

-0.03 

0.09 

0.32 

-0.34 

30A511 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A512 

* 

-1 

4888 

98 

1.17 

0.02 

0.00 

-0.17 

30A512 

A 

1 

99 

93 

2.83 

0.12 

0.97 

0.34 

30A512 

B 

0 

6 

6 

1.06 

0.23 

0.40 

-0.32 

30A512 

C 

0 

1 

1 

1.22 

0.00 

0.42 

-0.12 

30A512 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A513 

* 

-1 

4885 

98 

1.18 

0.02 

0.00 

-0.11 

30A513 

A 

1 

66 

61 

2.55 

0.14 

0.99 

0.42 

30A513 

B 

0 

13 

12 

1.76 

0.16 

0.88 

-0.14 

30A513 

C 

0 

30 

28 

1.52 

0.18 

0.91 

-0.36 

30A513 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A514 

* 

-1 

4874 

98 

1.19 

0.02 

0.00 

-0.09 

30A514 

A 

1 

89 

74 

2.21 

0.13 

1.01 

0.33 

30A514 

B 

0 

15 

13 

1.29 

0.19 

0.93 

-0.21 

30A514 

C 

0 

16 

13 

1.28 

0.27 

1.34 

-0.22 

30A514 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A515 

* 

-1 

4880 

98 

1.18 

0.02 

0.00 

-0.11 

30A515 

A 

1 

98 

86 

2.33 

0.13 

1.01 

0.38 

30A515 

B 

0 

11 

10 

1.01 

0.25 

0.77 

-0.27 

30A515 

C 

0 

5 

4 

0.57 

0.34 

0.45 

-0.25 

30A515 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30A516 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.08 

30A516 

A 

1 

89 

77 

2.22 

0.11 

0.88 

0.47 

30A516 

B 

0 

16 

14 

0.81 

0.18 

0.55 

-0.42 

30A516 

C 

0 

11 

9 

1.35 

0.18 

0.86 

-0.18 

30A516 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A517 

* 

-1 

4888 

98 

1.19 

0.02 

0.00 

-0.07 

30A517 

A 

1 

87 

82 

2.00 

0.10 

0.99 

0.40 

30A517 

B 

0 

15 

14 

0.97 

0.27 

0.97 

-0.32 

30A517 

C 

0 

4 

4 

0.66 

0.30 

0.49 

-0.21 

30A517 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A518 

* 

-1 

4887 

98 

1.20 

0.02 

0.00 

-0.04 

30A518 

A 

1 

78 

73 

1.90 

0.13 

0.88 

0.49 

30A518 

B 

0 

18 

17 

0.68 

0.23 

1.08 

-0.32 

30A518 

C 

0 

11 

10 

0.39 

0.18 

0.51 

-0.32 

30A518 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A519 

* 

-1 

4887 

98 

1.18 

0.02 

0.00 

-0.11 

30A519 

A 

1 

73 

68 

2.74 

0.17 

1.22 

0.50 

30A519 

B 

0 

21 

20 

1.39 

0.23 

1.24 

-0.27 

30A519 

C 

0 

13 

12 

0.66 

0.15 

0.37 

-0.39 

30A519 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A52 

* 

-1 

4880 

98 

1.19 

0.02 

0.00 

-0.10 

30A52 

A 

1 

111 

97 

2.12 

0.11 

0.92 

0.30 

30A52 

B 

0 

2 

2 

-0.11 

0.13 

0.21 

-0.24 

30A52 

C 

0 

1 

1 

-0.38 

0.00 

0.16 

-0.19 

30A52 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3OA520 

* 

-1 

4875 

98 

1.19 

0.02 

0.00 

-0.10 

3OA520 

A 

1 

95 

80 

2.34 

0.12 

0.90 

0.47 

3OA520 

B 

0 

13 

11 

1.07 

0.21 

0.71 

-0.27 

3OA520 

C 

0 

11 

9 

0.69 

0.25 

0.52 

-0.35 

3OA520 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30A53 

* 

-1 

4870 

98 

1.19 

0.02 

0.00 

-0.08 

30A53 

A 

1 

92 

74 

2.30 

0.12 

0.86 

0.53 

30A53 

B 

0 

17 

14 

0.94 

0.21 

0.76 

-0.30 

30A53 

C 

0 

15 

12 

0.56 

0.20 

0.49 

-0.40 

30A53 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A54 

* 

-1 

4880 

98 

1.19 

0.02 

0.00 

-0.07 

30A54 

A 

1 

86 

75 

2.15 

0.11 

0.83 

0.54 

30A54 

B 

0 

11 

10 

0.71 

0.21 

0.55 

-0.32 

30A54 

C 

0 

17 

15 

0.76 

0.13 

0.53 

-0.39 

30A54 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A55 

* 

-1 

4872 

98 

1.18 

0.02 

0.00 

-0.12 

30A55 

A 

1 

114 

93 

2.33 

0.10 

0.87 

0.41 

30A55 

B 

0 

6 

5 

0.19 

0.26 

0.26 

-0.41 

30A55 

C 

0 

2 

2 

1.29 

0.59 

0.77 

-0.11 

30A55 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A56 

* 

-1 

4750 

95 

1.17 

0.02 

0.00 

-0.11 

30A56 

A 

1 

223 

91 

1.99 

0.08 

0.96 

0.34 

30A56 

B 

0 

9 

4 

0.58 

0.22 

0.59 

-0.21 

30A56 

C 

0 

12 

5 

0.47 

0.18 

0.49 

-0.26 

30A56 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A57 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.12 

30A57 

A 

1 

96 

86 

2.49 

0.12 

0.97 

0.38 

30A57 

B 

0 

7 

6 

0.99 

0.32 

0.57 

-0.28 

30A57 

C 

0 

8 

7 

1.23 

0.24 

0.64 

-0.24 

30A57 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A58 

* 

-1 

4888 

98 

1.20 

0.02 

0.00 

-0.04 

30A58 

A 

1 

82 

77 

1.91 

0.12 

0.90 

0.47 

30A58 

B 

0 

17 

16 

0.73 

0.21 

0.81 

-0.33 

30A58 

C 

0 

7 

7 

0.25 

0.30 

0.45 

-0.31 

30A58 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30A59 

* 

-1 

4888 

98 

1.17 

0.02 

0.00 

-0.17 

30A59 

A 

1 

85 

80 

3.00 

0.13 

0.93 

0.46 

30A59 

B 

0 

4 

4 

1.75 

0.32 

0.68 

-0.15 

30A59 

C 

0 

17 

16 

1.49 

0.22 

0.65 

-0.42 

30A59 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A61 

* 

-1 

4885 

98 

1.18 

0.02 

0.00 

-0.11 

30A61 

A 

1 

72 

66 

2.45 

0.14 

1.11 

0.34 

30A61 

B 

0 

27 

25 

1.73 

0.17 

1.10 

-0.22 

30A61 

C 

0 

10 

9 

1.38 

0.24 

0.68 

-0.22 

30A61 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3OA610 

* 

-1 

4875 

98 

1.19 

0.02 

0.00 

-0.09 

3OA610 

A 

1 

70 

59 

2.60 

0.14 

0.83 

0.61 

3OA610 

B 

0 

26 

22 

1.08 

0.09 

0.55 

-0.38 

3OA610 

C 

0 

23 

19 

1.09 

0.15 

0.63 

-0.35 

3OA610 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A611 

* 

-1 

4884 

98 

1.19 

0.02 

0.00 

-0.10 

30A611 

A 

1 

62 

56 

2.79 

0.15 

0.82 

0.59 

30A611 

B 

0 

15 

14 

1.34 

0.24 

0.85 

-0.23 

30A611 

C 

0 

33 

30 

1.15 

0.16 

0.69 

-0.47 

30A611 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A613 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.08 

30A613 

A 

1 

71 

61 

2.32 

0.13 

1.01 

0.43 

30A613 

B 

0 

10 

9 

1.01 

0.27 

0.63 

-0.27 

30A613 

C 

0 

35 

30 

1.45 

0.12 

0.92 

-0.30 

30A613 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A614 

* 

-1 

4888 

98 

1.19 

0.02 

0.00 

-0.07 

30A614 

A 

1 

89 

84 

2.05 

0.10 

0.81 

0.54 

30A614 

B 

0 

7 

7 

0.48 

0.43 

0.59 

-0.33 

30A614 

C 

0 

10 

9 

0.53 

0.23 

0.49 

-0.39 

30A614 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30A615 

* 

-1 

4755 

95 

1.15 

0.02 

0.00 

-0.18 

30A615 

A 

1 

190 

79 

2.54 

0.08 

0.92 

0.48 

30A615 

B 

0 

27 

11 

1.09 

0.14 

0.56 

-0.36 

30A615 

C 

0 

22 

9 

1.25 

0.19 

0.73 

-0.27 

30A615 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A616 

* 

-1 

4887 

98 

1.20 

0.02 

0.00 

-0.04 

30A616 

A 

1 

61 

57 

2.08 

0.15 

0.92 

0.52 

30A616 

B 

0 

28 

26 

0.99 

0.16 

1.00 

-0.27 

30A616 

C 

0 

18 

17 

0.55 

0.17 

0.54 

-0.37 

30A616 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A617 

* 

-1 

4887 

98 

1.18 

0.02 

0.00 

-0.11 

30A617 

A 

1 

75 

70 

2.86 

0.15 

0.75 

0.65 

30A617 

B 

0 

21 

20 

0.95 

0.17 

0.60 

-0.42 

30A617 

C 

0 

11 

10 

0.29 

0.24 

0.30 

-0.43 

30A617 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A618 

* 

-1 

4880 

98 

1.19 

0.02 

0.00 

-0.10 

30A618 

A 

1 

64 

56 

2.44 

0.16 

1.32 

0.35 

30A618 

B 

0 

20 

18 

1.66 

0.23 

1.26 

-0.15 

30A618 

C 

0 

30 

26 

1.50 

0.16 

0.93 

-0.27 

30A618 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A619 

* 

-1 

4876 

98 

1.19 

0.02 

0.00 

-0.10 

30A619 

A 

1 

78 

66 

2.34 

0.15 

1.29 

0.31 

30A619 

B 

0 

18 

15 

1.53 

0.22 

1.02 

-0.18 

30A619 

C 

0 

22 

19 

1.52 

0.17 

0.97 

-0.21 

30A619 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A62 

* 

-1 

4872 

98 

1.19 

0.02 

0.00 

-0.08 

30A62 

A 

1 

97 

80 

2.23 

0.12 

0.87 

0.51 

30A62 

B 

0 

9 

7 

1.03 

0.33 

0.88 

-0.20 

30A62 

C 

0 

16 

13 

0.39 

0.14 

0.38 

-0.46 

30A62 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3OA620 

* 

-1 

4880 

98 

1.19 

0.02 

0.00 

-0.07 

3OA620 

A 

1 

65 

57 

2.24 

0.13 

0.92 

0.45 

3OA620 

B 

0 

19 

17 

0.87 

0.14 

0.53 

-0.38 

3OA620 

C 

0 

30 

26 

1.44 

0.18 

1.28 

-0.19 

3OA620 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A63 

* 

-1 

4872 

98 

1.18 

0.02 

0.00 

-0.12 

30A63 

A 

1 

81 

66 

2.53 

0.11 

0.96 

0.40 

30A63 

B 

0 

37 

30 

1.64 

0.18 

1.48 

-0.33 

30A63 

C 

0 

4 

3 

0.88 

0.42 

0.40 

-0.22 

30A63 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A64 

* 

-1 

4884 

98 

1.18 

0.02 

0.00 

-0.12 

30A64 

A 

1 

86 

78 

2.70 

0.11 

0.75 

0.60 

30A64 

B 

0 

9 

8 

0.88 

0.24 

0.42 

-0.35 

30A64 

C 

0 

15 

14 

0.93 

0.16 

0.44 

-0.45 

30A64 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A65 

* 

-1 

4888 

98 

1.20 

0.02 

0.00 

-0.04 

30A65 

A 

1 

59 

56 

2.17 

0.16 

1.17 

0.53 

30A65 

B 

0 

38 

36 

0.98 

0.12 

0.77 

-0.40 

30A65 

C 

0 

9 

8 

0.64 

0.25 

0.51 

-0.25 

30A65 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A66 

* 

-1 

4888 

98 

1.17 

0.02 

0.00 

-0.17 

30A66 

A 

1 

91 

86 

2.94 

0.13 

0.96 

0.44 

30A66 

B 

0 

9 

8 

1.38 

0.25 

0.57 

-0.32 

30A66 

C 

0 

6 

6 

1.25 

0.31 

0.48 

-0.28 

30A66 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A67 

* 

-1 

4885 

98 

1.18 

0.02 

0.00 

-0.11 

30A67 

A 

1 

61 

56 

2.49 

0.15 

1.22 

0.32 

30A67 

B 

0 

16 

15 

1.47 

0.20 

0.74 

-0.26 

30A67 

C 

0 

32 

29 

1.92 

0.17 

1.45 

-0.14 

30A67 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

easyCBM  CCSS  Third  Grade  Math  Measure  Development 


501 

Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30A68 

* 

-1 

4875 

98 

1.19 

0.02 

0.00 

-0.09 

30A68 

A 

1 

93 

78 

2.15 

0.13 

1.05 

0.27 

30A68 

B 

0 

11 

9 

1.58 

0.30 

1.81 

-0.10 

30A68 

C 

0 

15 

13 

1.17 

0.22 

0.87 

-0.25 

30A68 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A69 

* 

-1 

4884 

98 

1.19 

0.02 

0.00 

-0.10 

30A69 

A 

1 

65 

59 

2.75 

0.15 

0.87 

0.58 

30A69 

B 

0 

12 

11 

1.63 

0.36 

1.51 

-0.12 

30A69 

C 

0 

33 

30 

1.00 

0.13 

0.51 

-0.54 

30A69 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A81 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.08 

30A81 

A 

1 

65 

56 

2.38 

0.14 

1.03 

0.46 

30A81 

B 

0 

31 

27 

1.52 

0.13 

0.94 

-0.23 

30A81 

C 

0 

20 

17 

1.16 

0.15 

0.62 

-0.33 

30A81 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3OA810 

* 

-1 

4888 

98 

1.19 

0.02 

0.00 

-0.07 

3OA810 

A 

1 

73 

69 

2.07 

0.12 

1.14 

0.38 

3OA810 

B 

0 

21 

20 

1.28 

0.17 

0.91 

-0.25 

3OA810 

C 

0 

12 

11 

1.06 

0.32 

0.94 

-0.25 

3OA810 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A811 

* 

-1 

4883 

98 

1.20 

0.02 

0.00 

-0.04 

30A811 

A 

1 

46 

41 

2.11 

0.19 

1.25 

0.40 

30A811 

B 

0 

56 

50 

1.14 

0.13 

1.12 

-0.33 

30A811 

C 

0 

9 

8 

1.10 

0.25 

0.80 

-0.11 

30A811 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A812 

* 

-1 

4886 

98 

1.18 

0.02 

0.00 

-0.11 

30A812 

A 

1 

73 

68 

2.78 

0.16 

1.09 

0.55 

30A812 

B 

0 

12 

11 

1.28 

0.27 

0.84 

-0.22 

30A812 

C 

0 

23 

21 

0.91 

0.20 

0.66 

-0.45 

30A812 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30A813 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.10 

30A813 

A 

1 

90 

78 

2.23 

0.13 

1.11 

0.29 

30A813 

B 

0 

10 

9 

0.92 

0.26 

0.63 

-0.28 

30A813 

C 

0 

16 

14 

1.68 

0.21 

1.33 

-0.12 

30A813 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A814 

* 

-1 

4873 

98 

1.18 

0.02 

0.00 

-0.10 

30A814 

A 

1 

74 

61 

2.40 

0.15 

1.19 

0.35 

30A814 

B 

0 

44 

36 

1.57 

0.14 

1.07 

-0.29 

30A814 

C 

0 

3 

2 

0.64 

0.56 

0.38 

-0.18 

30A814 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A815 

* 

-1 

4867 

97 

1.19 

0.02 

0.00 

-0.08 

30A815 

A 

1 

98 

77 

2.24 

0.11 

0.89 

0.48 

30A815 

B 

0 

13 

10 

0.66 

0.30 

1.16 

-0.34 

30A815 

C 

0 

16 

13 

0.90 

0.26 

1.01 

-0.31 

30A815 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A816 

* 

-1 

4877 

98 

1.19 

0.02 

0.00 

-0.07 

30A816 

A 

1 

82 

70 

2.15 

0.13 

0.95 

0.44 

30A816 

B 

0 

16 

14 

0.75 

0.16 

0.54 

-0.37 

30A816 

C 

0 

19 

16 

1.28 

0.19 

1.08 

-0.20 

30A816 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A817 

* 

-1 

4867 

97 

1.18 

0.02 

0.00 

-0.12 

30A817 

A 

1 

66 

52 

2.66 

0.13 

0.96 

0.43 

30A817 

B 

0 

57 

45 

1.69 

0.13 

0.97 

-0.42 

30A817 

C 

0 

4 

3 

1.92 

0.77 

1.90 

-0.05 

30A817 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A818 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.12 

30A818 

A 

1 

64 

58 

2.85 

0.15 

0.94 

0.52 

30A818 

B 

0 

22 

20 

1.80 

0.17 

0.93 

-0.20 

30A818 

C 

0 

25 

23 

1.34 

0.18 

0.62 

-0.42 

30A818 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30A819 

* 

-1 

4888 

98 

1.20 

0.02 

0.00 

-0.04 

30A819 

A 

1 

57 

54 

2.04 

0.16 

1.25 

0.39 

30A819 

B 

0 

23 

22 

1.00 

0.19 

0.83 

-0.27 

30A819 

C 

0 

26 

25 

1.22 

0.20 

1.23 

-0.19 

30A819 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A82 

* 

-1 

4885 

98 

1.17 

0.02 

0.00 

-0.16 

30A82 

A 

1 

54 

50 

3.16 

0.17 

1.17 

0.37 

30A82 

B 

0 

41 

38 

2.41 

0.17 

1.46 

-0.17 

30A82 

C 

0 

14 

13 

1.64 

0.25 

0.56 

-0.32 

30A82 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3OA820 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.11 

3OA820 

A 

1 

75 

68 

2.53 

0.13 

0.93 

0.47 

3OA820 

B 

0 

18 

16 

1.63 

0.17 

0.93 

-0.21 

3OA820 

C 

0 

18 

16 

1.16 

0.18 

0.58 

-0.39 

3OA820 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A83 

* 

-1 

4778 

96 

1.16 

0.02 

0.00 

-0.15 

30A83 

A 

1 

110 

51 

2.74 

0.13 

1.24 

0.43 

30A83 

B 

0 

75 

35 

1.74 

0.12 

1.14 

-0.23 

30A83 

C 

0 

31 

14 

1.18 

0.17 

0.68 

-0.30 

30A83 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A84 

* 

-1 

4872 

98 

1.19 

0.02 

0.00 

-0.09 

30A84 

A 

1 

71 

58 

2.49 

0.15 

0.97 

0.51 

30A84 

B 

0 

34 

28 

1.11 

0.12 

0.68 

-0.43 

30A84 

C 

0 

17 

14 

1.45 

0.18 

0.98 

-0.17 

30A84 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A85 

* 

-1 

4878 

98 

1.18 

0.02 

0.00 

-0.11 

30A85 

A 

1 

70 

60 

2.59 

0.15 

1.01 

0.43 

30A85 

B 

0 

43 

37 

1.49 

0.17 

1.30 

-0.37 

30A85 

C 

0 

3 

3 

0.33 

0.46 

0.25 

-0.22 

30A85 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

30A86 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.08 

30A86 

A 

1 

73 

63 

2.34 

0.13 

0.94 

0.49 

30A86 

B 

0 

22 

19 

1.21 

0.15 

0.72 

-0.33 

30A86 

C 

0 

21 

18 

1.31 

0.14 

0.76 

-0.28 

30A86 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A87 

* 

-1 

4886 

98 

1.19 

0.02 

0.00 

-0.07 

30A87 

A 

1 

72 

67 

2.09 

0.11 

0.99 

0.39 

30A87 

B 

0 

25 

23 

1.35 

0.17 

1.00 

-0.24 

30A87 

C 

0 

11 

10 

0.93 

0.37 

0.83 

-0.28 

30A87 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A88 

* 

-1 

4885 

98 

1.18 

0.02 

0.00 

-0.11 

30A88 

A 

1 

45 

41 

2.56 

0.19 

1.53 

0.29 

30A88 

B 

0 

17 

16 

1.61 

0.18 

0.71 

-0.21 

30A88 

C 

0 

47 

43 

2.01 

0.14 

1.41 

-0.13 

30A88 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30A89 

* 

-1 

4875 

98 

1.19 

0.02 

0.00 

-0.09 

30A89 

A 

1 

50 

42 

2.43 

0.19 

1.29 

0.32 

30A89 

B 

0 

30 

25 

1.34 

0.16 

0.77 

-0.30 

30A89 

C 

0 

39 

33 

1.88 

0.18 

1.75 

-0.06 

30A89 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

